-- Logs begin at Fri 2022-05-27 08:52:13 UTC, end at Fri 2022-05-27 09:56:38 UTC. -- May 27 09:21:43.165723 dv-cinder-797608-21-smb systemd[1]: Starting Devstack devstack@keystone.service... May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 09:21:43 2022] *** May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: nodename: dv-cinder-797608-21-smb May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: machine: x86_64 May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: clock source: unix May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: pcre jit disabled May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: detected number of CPU cores: 4 May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: current working directory: / May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: detected binary path: /usr/bin/uwsgi-core May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: your processes number limit is 47680 May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: your memory page size is 4096 bytes May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: detected max file descriptor number: 2048 May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: lock engine: pthread robust mutexes May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: thunder lock: enabled May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 09:21:43.180950 dv-cinder-797608-21-smb devstack@keystone.service[80137]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 09:21:43.221360 dv-cinder-797608-21-smb devstack@keystone.service[80137]: Python main interpreter initialized at 0x564bb8ae49c0 May 27 09:21:43.221360 dv-cinder-797608-21-smb devstack@keystone.service[80137]: python threads support enabled May 27 09:21:43.221360 dv-cinder-797608-21-smb devstack@keystone.service[80137]: your server socket listen backlog is limited to 100 connections May 27 09:21:43.221360 dv-cinder-797608-21-smb devstack@keystone.service[80137]: your mercy for graceful operations on workers is 90 seconds May 27 09:21:43.221718 dv-cinder-797608-21-smb devstack@keystone.service[80137]: mapped 403077 bytes (393 KB) for 2 cores May 27 09:21:43.221821 dv-cinder-797608-21-smb devstack@keystone.service[80137]: *** Operational MODE: preforking *** May 27 09:21:43.222099 dv-cinder-797608-21-smb devstack@keystone.service[80137]: *** uWSGI is running in multiple interpreter mode *** May 27 09:21:43.222099 dv-cinder-797608-21-smb devstack@keystone.service[80137]: spawned uWSGI master process (pid: 80137) May 27 09:21:43.222294 dv-cinder-797608-21-smb systemd[1]: Started Devstack devstack@keystone.service. May 27 09:21:43.224273 dv-cinder-797608-21-smb devstack@keystone.service[80137]: spawned uWSGI worker 1 (pid: 80148, cores: 1) May 27 09:21:43.224273 dv-cinder-797608-21-smb devstack@keystone.service[80137]: spawned uWSGI worker 2 (pid: 80149, cores: 1) May 27 09:21:43.224273 dv-cinder-797608-21-smb devstack@keystone.service[80137]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 09:21:48.873445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:21:48.873445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: from cryptography.utils import int_from_bytes May 27 09:21:48.874214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:21:48.874214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: from cryptography.utils import int_from_bytes May 27 09:21:48.874417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:21:48.874417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: from cryptography.utils import int_from_bytes May 27 09:21:48.874932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:21:48.874932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: from cryptography.utils import int_from_bytes May 27 09:21:48.922877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:21:48.923048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:21:48.923243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] command line args: [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:21:48.923508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:21:48.923595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:21:48.923679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ================================================================================ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:21:48.923758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:21:48.923894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] command line args: [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:21:48.923979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] admin_token = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.924148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] config_dir = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.924233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:21:48.924340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ================================================================================ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:21:48.924419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.924516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] config_source = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.924595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] admin_token = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.925245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] debug = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.925373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] config_dir = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.925447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.925697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.925770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] config_source = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.925831 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.925899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] debug = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.925960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] log_config_append = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.926992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927164 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] log_dir = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] log_file = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_config_append = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_dir = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.927895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.928973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929825 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.929976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.930069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.930219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.930305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.930461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.930546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.930717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.930844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.930962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.931199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.931329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.931415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] publish_errors = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.931594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.931707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.931819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.931910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] publish_errors = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.931983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.932106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.932222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.932308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.932453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.932593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.932676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] standard_threads = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.932754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.932920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] standard_threads = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] use_journal = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] use_json = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] use_stderr = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.933959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_journal = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.934044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] use_syslog = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.934126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_json = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.934199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.934280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_stderr = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.934450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.934529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_syslog = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.934685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:21:48.934773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.934941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935177 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935262 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.935979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.936133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.936296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.936378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.936456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.936604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.936682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.936866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.936980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.937103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.937193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.937348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.937428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.937580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.937666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.937830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.937912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.938069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.938149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.938301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.938390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.938553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.938630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.938794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.938873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.939033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.939118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.939266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.939346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.939517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.939595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.939751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.939836 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.940006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.940085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.940368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.940989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.941993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.942146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.942226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.942384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.942541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.942616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.942687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.942841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.942921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.943087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.943173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.943316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.943393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.943559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.943637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.943789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.943877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.944962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.945118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.945202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.945351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.945431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.945582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.945661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.945812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.945891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.946042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.946122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.946267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.946352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.946502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.946581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.946732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.946811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.947960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.948999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.949090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.949233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.949312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.949462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.949549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.949713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.949807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.949943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.950065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.950206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.950304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.950400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.950480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.950630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.950753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.950881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.951885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.952033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.952114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.952265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.952356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.952507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.952592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.952742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.952821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953545 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953700 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.953986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.954933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.955089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.955175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.955322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.955402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.955561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.955647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.955795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.955885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.956062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.956147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.956294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.956380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.956521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.956611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.956748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.956883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.957923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.958950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.959104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.959184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.959332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.external = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.959412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.959560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.959648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.959829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.959908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.960065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.960143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.960292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.password = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.960401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.external = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.960519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.960600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] auth.token = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.960755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.960861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.961011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.961092 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.961258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.961341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.password = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.961489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.961569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.token = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.961985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.962070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.962221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.962303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.962449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.962528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.962681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.962761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.962927 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.963956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.964110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.964189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.964357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.964437 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.964598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.964678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.964846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.964928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.965094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.965181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.965359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.965439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.965602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.965681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.965841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.965921 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.966087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.966174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.966342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.966423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.966576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.966658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.966810 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.966890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.967054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.967134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.967299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.967380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.967526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.967606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.967776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.967861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.968984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.969066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.969230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.969310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.969463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.969546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.969708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.969795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.969944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970406 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.970959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.971114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.971201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.971347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.971434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.971619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.971702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.971849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.971928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.972078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.972167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.972308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.972388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.972548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.972628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.972784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.972892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.973045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.973126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.973278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.973359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.973523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.973611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.973770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.973851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.974939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.975950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.976102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.976181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.976339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.976426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.976578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.976659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.976810 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.976910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.977998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.978078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.978234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.978315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.978469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.978573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.978709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.978823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.978947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.979970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.980111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.980193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.980357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.980444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.980601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.980689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.980858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.980941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.981084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.981164 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.981313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.981405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.981540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.981621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.981776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.981856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.982979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.983210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.983289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.983456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.983544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.983701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.983781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.983991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.984071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.984221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.984308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.984457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.984684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.984765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.984949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.985030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.985196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.985304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.985439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.985546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.985682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.985763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.985926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.986949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.987084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.987690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.987839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.987942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.988083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.988184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.988332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.988413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.988568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.988651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.988820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.988971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.989069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.989150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.989310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.989393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.989553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.989634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.989786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.989866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.990967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.991046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.991201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.991281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.991449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.991537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.991682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.991769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.991922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.992007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.992214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.992304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.992465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.992545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.992718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.992799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.992984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.993067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.993224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.993304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.993463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.993544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.993697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] role.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.993779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.993941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] role.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] role.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.994968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] role.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.995125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.995206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.995368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.995447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.995613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.995694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.995858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.995939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.996101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.996180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.996331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.996419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.996576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.996656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.996819 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.996955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.997085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.997176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.997316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.997395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.997561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.997703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.997807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.997936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.998153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.998234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.998404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.998485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.998659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.998797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.998905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.999037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.999139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.999293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.999373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.999543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.999625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.999794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:48.999875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.000048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.000129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.000283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.000363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.000513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.000594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.000761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.000861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.001966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.002045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.002199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] token.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.002291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.002434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.002515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.002678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.002788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.003477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.003570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.003714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.003793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.003953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.004033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.004187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.004275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.004429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.004510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.004664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.004744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.004933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.005952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.006115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.006196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.006344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.006433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.006583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.006662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.006830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.006910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.007080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.007169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.007329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.007423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.007562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.007643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.007804 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.007884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.008041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.008129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.008278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.008359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.008511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.008601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.008746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.008841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.009951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.010968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.011118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.011195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.011342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.011424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.011498 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:21:49.011594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.011841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.012072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.012312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.012550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:21:49.012723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:21:49.041689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.041915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.042135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.042220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.042371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.042602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.051156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.051710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.079417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.079643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.080098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.080333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.131614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.132165 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.182185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.182410 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.183504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.183740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.247803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.248033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.248257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.248358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.248478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.248562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.248696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.248780 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.248935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.249031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.249152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.249369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.272051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.272285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.272391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.272561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.272646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.272786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.272890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.273037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.273123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.273254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.273340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.273469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.273552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.273688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.285265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.285633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.297764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.298002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.298269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.298491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.298606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.298709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.298848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.298938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.299079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.299161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.299305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.299528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.299800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.300533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:21:49.318856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.319066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:21:49.319401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.319508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.319589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:21:49.319727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:21:49.319847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.320068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.320155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.320272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:21:49.320368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.320544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.320626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.320805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.321092 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.321348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.331504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.331777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.332041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.332274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.332374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.332552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.332819 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.333123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.340615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.341433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.343876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.344152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.344432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.344679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.344775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.344986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.345071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.345243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.345325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.345535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.345630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.345815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.345899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.346074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.346157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.346385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.346467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.347166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.347249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.347501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.347783 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.348129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.375096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.376812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.376990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.377116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.380158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.380648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.382834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.383077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.383362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.388970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.389249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.389530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.390622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.390905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.395391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.395796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.396083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.396366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.396640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.396737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.396944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.397052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.397223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.397485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.401425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.401826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.402108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.402391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.402666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.402938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.403206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.403472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.416498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.416762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.421457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.422339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.422613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.425639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.425931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.427839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.431162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.431477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.431768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.434767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.436770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.438531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.438832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.439125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.439408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.439691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.439967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.440359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.444106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.444403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.444694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.445005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.445289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.445564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.458903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.459187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.459453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.459716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.464536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.464815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.465104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.465364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.467952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.469672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.469961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.473542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.473820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.473903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.474099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.474376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.474651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.475486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.475766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.478790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.479067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.479348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.479625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.479897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.488511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.488791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.489106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.489388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.489668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.489952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.490235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.493794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.494070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.494348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.494623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.494898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.495176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.495453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.508079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.511322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.513283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.514607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.516206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.516474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.517865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.518150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.518456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.519781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.521395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.523012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.523297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.523577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.525837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.527440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.530697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.530895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.530979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.531259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.531536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.532486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.536225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.536519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.536801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.537102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.541113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.541399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.541786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.546112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.546398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.546781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.550156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.550505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.550791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.551065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.551334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.551606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.551900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.552167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.552434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.552708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.552999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.553261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.553539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.553805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.555119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:21:49.555397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.555677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.555948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.556215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.556483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.556776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.557062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.557326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.557595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.557861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.558116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.558387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.558641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:21:49.592439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bb8ae49c0 pid: 80149 (default app) May 27 09:21:49.595649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13119-6380-4050-9620-4f68eee95cb1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:21:49.595943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13119-6380-4050-9620-4f68eee95cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:21:49.596222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13119-6380-4050-9620-4f68eee95cb1 None None] PATH_INFO: `/v3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:21:49.597587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bb8ae49c0 pid: 80148 (default app) May 27 09:21:49.601084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Fri May 27 09:21:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:21:57.439484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d70f6-ef45-488d-96e5-5f946f9742cc None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:21:57.440040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d70f6-ef45-488d-96e5-5f946f9742cc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:21:57.440040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d70f6-ef45-488d-96e5-5f946f9742cc None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:21:57.445172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:21:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:21:57.450203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:21:57.450592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:21:57.450757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:21:57.526598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: INFO dbcounter [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] Registered counter for database keystone May 27 09:21:57.547881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG oslo_db.sqlalchemy.engines [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:21:57.554762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writer thread running {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:21:57.725477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG passlib.handlers.bcrypt [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80149) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 09:21:57.725884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG passlib.handlers.bcrypt [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80149) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 09:21:57.780478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:21:57.782096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:21:57.905542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:21:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 09:21:58.091184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d70f6-ef45-488d-96e5-5f946f9742cc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:21:58.163195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: INFO dbcounter [None req-a41d70f6-ef45-488d-96e5-5f946f9742cc None None] Registered counter for database keystone May 27 09:21:58.184375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG oslo_db.sqlalchemy.engines [None req-a41d70f6-ef45-488d-96e5-5f946f9742cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:21:58.190598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writer thread running {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:21:58.309956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d70f6-ef45-488d-96e5-5f946f9742cc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:21:58.314190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f1f1d-83ca-496c-b188-b9fbadcc700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:21:58.314861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f1f1d-83ca-496c-b188-b9fbadcc700d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:21:58.315188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f1f1d-83ca-496c-b188-b9fbadcc700d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:21:58.315467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f1f1d-83ca-496c-b188-b9fbadcc700d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:21:58.323497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f1f1d-83ca-496c-b188-b9fbadcc700d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:21:58.374453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a9f1f1d-83ca-496c-b188-b9fbadcc700d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 09:21:58.374796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f1f1d-83ca-496c-b188-b9fbadcc700d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:21:58.384207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Fri May 27 09:21:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:21:58.390215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:21:58.404538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f66db2-3bf1-409c-b66f-a99ecbde8ed3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:21:58.409526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dab96-4e80-45ec-a75d-ef9f18cba41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:21:58.410635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dab96-4e80-45ec-a75d-ef9f18cba41e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:21:58.410920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dab96-4e80-45ec-a75d-ef9f18cba41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:21:58.411196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dab96-4e80-45ec-a75d-ef9f18cba41e admin admin] PATH_INFO: `/v3/projects/8f1d06ca36e140b391bdeae31455b36e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:21:58.412720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175dab96-4e80-45ec-a75d-ef9f18cba41e admin admin] RBAC: Authorizing `identity:get_project(project_id=8f1d06ca36e140b391bdeae31455b36e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:21:58.575864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING keystone.common.rbac_enforcer.enforcer [None req-175dab96-4e80-45ec-a75d-ef9f18cba41e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 09:21:58.576520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175dab96-4e80-45ec-a75d-ef9f18cba41e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:21:58.580974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Fri May 27 09:21:58 2022] GET /identity/v3/projects/8f1d06ca36e140b391bdeae31455b36e => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:00.719808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771128-54b0-4045-b8fa-eb2fe090326f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:00.720310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771128-54b0-4045-b8fa-eb2fe090326f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:00.720310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771128-54b0-4045-b8fa-eb2fe090326f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:00.724978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:00.730232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171c327-6e6c-42fb-bb83-96f72bfb4928 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:00.730603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171c327-6e6c-42fb-bb83-96f72bfb4928 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:00.730797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171c327-6e6c-42fb-bb83-96f72bfb4928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:00.749781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e171c327-6e6c-42fb-bb83-96f72bfb4928 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:00.751286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e171c327-6e6c-42fb-bb83-96f72bfb4928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:00.759124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 09:22:00.780328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8771128-54b0-4045-b8fa-eb2fe090326f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:00.792719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8771128-54b0-4045-b8fa-eb2fe090326f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:00.796999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc9bc9-abb1-4d9e-8778-0f71e117b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:00.797629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc9bc9-abb1-4d9e-8778-0f71e117b941 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:00.797917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc9bc9-abb1-4d9e-8778-0f71e117b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:00.798196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc9bc9-abb1-4d9e-8778-0f71e117b941 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:00.806399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc9bc9-abb1-4d9e-8778-0f71e117b941 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:00.808165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc9bc9-abb1-4d9e-8778-0f71e117b941 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:00.817319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Fri May 27 09:22:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:22:00.822363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171c327-6e6c-42fb-bb83-96f72bfb4928 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:00.831649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171c327-6e6c-42fb-bb83-96f72bfb4928 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:00.835996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4994e71-0cf4-4078-82e6-35b143209f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:00.837136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4994e71-0cf4-4078-82e6-35b143209f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:00.837421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4994e71-0cf4-4078-82e6-35b143209f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:00.837698 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4994e71-0cf4-4078-82e6-35b143209f27 admin admin] PATH_INFO: `/v3/users/35a1bb04fdb644fe910032efa086d057` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:00.839083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4994e71-0cf4-4078-82e6-35b143209f27 admin admin] RBAC: Authorizing `identity:get_user(user_id=35a1bb04fdb644fe910032efa086d057)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:00.840926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4994e71-0cf4-4078-82e6-35b143209f27 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:00.842463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Fri May 27 09:22:00 2022] GET /identity/v3/users/35a1bb04fdb644fe910032efa086d057 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:03.059086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db1d8-2a1e-4700-9cd5-4d74ccda8820 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.059623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db1d8-2a1e-4700-9cd5-4d74ccda8820 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.059623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db1d8-2a1e-4700-9cd5-4d74ccda8820 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.061012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:03.066128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b4acc-0353-4139-98bb-daafc3afd2a3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.066509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b4acc-0353-4139-98bb-daafc3afd2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.066702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b4acc-0353-4139-98bb-daafc3afd2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.083503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-664b4acc-0353-4139-98bb-daafc3afd2a3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:03.084715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-664b4acc-0353-4139-98bb-daafc3afd2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:03.104651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6121a-280f-40b7-ab0e-0a7c48befb80 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.104972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6121a-280f-40b7-ab0e-0a7c48befb80 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.105256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6121a-280f-40b7-ab0e-0a7c48befb80 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.106597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:03.111645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.111940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.112221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.151674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG passlib.handlers.bcrypt [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80148) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 09:22:03.152088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG passlib.handlers.bcrypt [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80148) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 09:22:03.164156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:03.186887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b4acc-0353-4139-98bb-daafc3afd2a3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:03.198365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:03.199949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:03.210596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:03.290877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b4acc-0353-4139-98bb-daafc3afd2a3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:03.301504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:03.322747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:03.326754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04deb8f9-57b3-42ce-bac9-3941e00ddb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:03.327555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deb8f9-57b3-42ce-bac9-3941e00ddb4c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.327844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deb8f9-57b3-42ce-bac9-3941e00ddb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.328126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deb8f9-57b3-42ce-bac9-3941e00ddb4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.340487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04deb8f9-57b3-42ce-bac9-3941e00ddb4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-04deb8f9-57b3-42ce-bac9-3941e00ddb4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:03.352595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:03.353882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:03.355032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 7/14] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:03.360045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04deb8f9-57b3-42ce-bac9-3941e00ddb4c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:03.445538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:03.463725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04deb8f9-57b3-42ce-bac9-3941e00ddb4c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:03.496957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:03.497623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.497907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.498187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.498931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:03.499239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:03.500642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:03.512146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 8/15] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:03.517643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:03.530239 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01143ee4-6686-479b-8598-bba05aedb0e3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:03.532580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:03.567686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae248c-7291-4398-8e31-56519b7f45d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:03.568585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae248c-7291-4398-8e31-56519b7f45d4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.568896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae248c-7291-4398-8e31-56519b7f45d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.569178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae248c-7291-4398-8e31-56519b7f45d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.616862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234d3e6-463e-4231-880d-401ef72eadb1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:03.636661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae248c-7291-4398-8e31-56519b7f45d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:03.638211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae248c-7291-4398-8e31-56519b7f45d4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:03.650479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d2649-5e96-47ef-befa-1699700a182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:03.651353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d2649-5e96-47ef-befa-1699700a182f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.651640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d2649-5e96-47ef-befa-1699700a182f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.651923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d2649-5e96-47ef-befa-1699700a182f None admin] PATH_INFO: `/v3/users/35a1bb04fdb644fe910032efa086d057` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.653160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d2649-5e96-47ef-befa-1699700a182f None admin] RBAC: Authorizing `identity:get_user(user_id=35a1bb04fdb644fe910032efa086d057)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:03.654610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d2649-5e96-47ef-befa-1699700a182f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:03.656248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 9/16] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:03 2022] GET /identity/v3/users/35a1bb04fdb644fe910032efa086d057 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:03.662127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d2649-5e96-47ef-befa-1699700a182f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:03.676255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:03.734696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 8/17] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:22:03.740346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae248c-7291-4398-8e31-56519b7f45d4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:03.743143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:03.761463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d2649-5e96-47ef-befa-1699700a182f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:03.795477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4de568-4be9-4f81-8b0f-7f74422eb8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:03.796266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4de568-4be9-4f81-8b0f-7f74422eb8eb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.796556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4de568-4be9-4f81-8b0f-7f74422eb8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.796848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4de568-4be9-4f81-8b0f-7f74422eb8eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.798065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4de568-4be9-4f81-8b0f-7f74422eb8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:03.799542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4de568-4be9-4f81-8b0f-7f74422eb8eb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:03.801183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 10/18] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:03.806891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4de568-4be9-4f81-8b0f-7f74422eb8eb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:03.836587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae248c-7291-4398-8e31-56519b7f45d4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:03.869430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:03.870160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.870446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.870730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.885150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:03.889787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:03.891266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:03.905133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4de568-4be9-4f81-8b0f-7f74422eb8eb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:22:03.911874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:03.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:03.913583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:22:03.913583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:22:03.913583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:22:03.913583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:03.913583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 9/19] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:03.919005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:03.939034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00005a0c-ae08-448d-8fce-b07aa59a496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:03.939740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00005a0c-ae08-448d-8fce-b07aa59a496b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:03.940013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00005a0c-ae08-448d-8fce-b07aa59a496b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:03.940294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00005a0c-ae08-448d-8fce-b07aa59a496b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:03.941180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00005a0c-ae08-448d-8fce-b07aa59a496b None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.domain.id=default, user.id=35a1bb04fdb644fe910032efa086d057) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:03.941493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00005a0c-ae08-448d-8fce-b07aa59a496b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:03.942944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00005a0c-ae08-448d-8fce-b07aa59a496b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:03.949718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 11/20] 10.222.0.79 () {56 vars in 1322 bytes} [Fri May 27 09:22:03 2022] GET /identity/v3/role_assignments?user.id=35a1bb04fdb644fe910032efa086d057&scope.domain.id=default&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:03.979903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:04.026806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e013b-fa82-47d8-a701-cacf2fb39405 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:04.062819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7be23-624b-45f9-8bd1-d3bbfa51690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:04.063525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7be23-624b-45f9-8bd1-d3bbfa51690f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:04.063776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7be23-624b-45f9-8bd1-d3bbfa51690f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:04.064054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7be23-624b-45f9-8bd1-d3bbfa51690f None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:04.064853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7be23-624b-45f9-8bd1-d3bbfa51690f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:04.065168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7be23-624b-45f9-8bd1-d3bbfa51690f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:04.066618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7be23-624b-45f9-8bd1-d3bbfa51690f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:04.085427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 10/21] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:06.495644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8850-682a-4bfc-bfec-d47c22e260d3 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:06.496180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8850-682a-4bfc-bfec-d47c22e260d3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:06.496256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8850-682a-4bfc-bfec-d47c22e260d3 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:06.497977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 12/22] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:06.503655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf646c-ac23-4eb6-971d-49b0ceab8bdb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:06.504100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf646c-ac23-4eb6-971d-49b0ceab8bdb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:06.504188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf646c-ac23-4eb6-971d-49b0ceab8bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:06.530629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6caf646c-ac23-4eb6-971d-49b0ceab8bdb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:06.531061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6caf646c-ac23-4eb6-971d-49b0ceab8bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:06.620493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 11/23] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:06.666340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8850-682a-4bfc-bfec-d47c22e260d3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:06.795597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8850-682a-4bfc-bfec-d47c22e260d3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:06.833970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b68d-68ee-4a85-9b04-c648a7c04102 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:06.834323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b68d-68ee-4a85-9b04-c648a7c04102 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:06.834539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b68d-68ee-4a85-9b04-c648a7c04102 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:06.836111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 12/24] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:06.847124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4dde8-b75d-41a9-b696-03488670e454 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:06.847413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4dde8-b75d-41a9-b696-03488670e454 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:06.847693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4dde8-b75d-41a9-b696-03488670e454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:06.865675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45077d-fc6a-4f43-b156-f0b7f3c60386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:06.866475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45077d-fc6a-4f43-b156-f0b7f3c60386 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:06.866759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45077d-fc6a-4f43-b156-f0b7f3c60386 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:06.867038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45077d-fc6a-4f43-b156-f0b7f3c60386 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:06.880887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-37c4dde8-b75d-41a9-b696-03488670e454 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:06.882202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-37c4dde8-b75d-41a9-b696-03488670e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:06.891326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45077d-fc6a-4f43-b156-f0b7f3c60386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fe45077d-fc6a-4f43-b156-f0b7f3c60386 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:06.898965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:06.899843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:06.901102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 13/25] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:06.915283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45077d-fc6a-4f43-b156-f0b7f3c60386 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:06.922871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:06.978453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:07.034333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 13/26] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:07.057248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134fca-ff19-4ad1-9811-a9a3cde26a0c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.057541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134fca-ff19-4ad1-9811-a9a3cde26a0c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.057827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134fca-ff19-4ad1-9811-a9a3cde26a0c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.059178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 14/27] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:07.064156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baf4c3-f59e-43a8-a25f-b4134f5d4f0d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.064442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baf4c3-f59e-43a8-a25f-b4134f5d4f0d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.065330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baf4c3-f59e-43a8-a25f-b4134f5d4f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.091639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d4baf4c3-f59e-43a8-a25f-b4134f5d4f0d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:07.093803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d4baf4c3-f59e-43a8-a25f-b4134f5d4f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:07.126230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45077d-fc6a-4f43-b156-f0b7f3c60386 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:07.205013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:07.205650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.205930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.206215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.206977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:07.207287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:07.208694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:07.227031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 14/28] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:07.227898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:07.232549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 15/29] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:07.233438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baf4c3-f59e-43a8-a25f-b4134f5d4f0d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:07.354707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:07.390885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baf4c3-f59e-43a8-a25f-b4134f5d4f0d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:07.398316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f3d0d-993e-4c2f-99ca-bdcbdc2c7177 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:07.400152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:07.435997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aded4-7910-4723-a3d1-dc766bef0f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:07.437014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aded4-7910-4723-a3d1-dc766bef0f68 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.437368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aded4-7910-4723-a3d1-dc766bef0f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.437719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aded4-7910-4723-a3d1-dc766bef0f68 None admin] PATH_INFO: `/v3/users/35a1bb04fdb644fe910032efa086d057` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.439414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1aded4-7910-4723-a3d1-dc766bef0f68 None admin] RBAC: Authorizing `identity:get_user(user_id=35a1bb04fdb644fe910032efa086d057)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:07.439912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0797-94f1-4392-aa47-621a3c9ac2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:07.440657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0797-94f1-4392-aa47-621a3c9ac2d9 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.441047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0797-94f1-4392-aa47-621a3c9ac2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.441213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1aded4-7910-4723-a3d1-dc766bef0f68 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:07.441460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0797-94f1-4392-aa47-621a3c9ac2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.442286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0797-94f1-4392-aa47-621a3c9ac2d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:07.443082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 16/30] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:07 2022] GET /identity/v3/users/35a1bb04fdb644fe910032efa086d057 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:07.443938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aded4-7910-4723-a3d1-dc766bef0f68 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:07.449463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0797-94f1-4392-aa47-621a3c9ac2d9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:07.558063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aded4-7910-4723-a3d1-dc766bef0f68 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:07.599201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79330261-446b-479a-85ae-95f614882afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:07.600132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79330261-446b-479a-85ae-95f614882afe None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.600611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79330261-446b-479a-85ae-95f614882afe None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.601100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79330261-446b-479a-85ae-95f614882afe None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.602055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79330261-446b-479a-85ae-95f614882afe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:07.603655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79330261-446b-479a-85ae-95f614882afe None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:07.604131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 15/31] 10.222.0.79 () {60 vars in 1131 bytes} [Fri May 27 09:22:07 2022] POST /identity/v3/roles => generated 219 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:07.606294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8198-3ea5-42ea-9e5e-067d884ed9ca None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.606848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8198-3ea5-42ea-9e5e-067d884ed9ca None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.607355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8198-3ea5-42ea-9e5e-067d884ed9ca None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.608944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 16/32] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:07.609917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8198-3ea5-42ea-9e5e-067d884ed9ca None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:07.821998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 17/33] 10.222.0.79 () {60 vars in 1131 bytes} [Fri May 27 09:22:07 2022] POST /identity/v3/roles => generated 225 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:07.823422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09f9a-410d-48df-af93-b4fb0ae87e11 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.823913 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09f9a-410d-48df-af93-b4fb0ae87e11 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.824431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09f9a-410d-48df-af93-b4fb0ae87e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.841062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8198-3ea5-42ea-9e5e-067d884ed9ca None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:07.856760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3ce09f9a-410d-48df-af93-b4fb0ae87e11 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:07.858435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3ce09f9a-410d-48df-af93-b4fb0ae87e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:07.878215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:07.897772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1685d4-3f56-4747-9d0b-795ec5ae24d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:07.898863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1685d4-3f56-4747-9d0b-795ec5ae24d6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:07.899288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1685d4-3f56-4747-9d0b-795ec5ae24d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:07.899716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1685d4-3f56-4747-9d0b-795ec5ae24d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:07.901407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1685d4-3f56-4747-9d0b-795ec5ae24d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:07.903897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1685d4-3f56-4747-9d0b-795ec5ae24d6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:07.906484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 17/34] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:07.912510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1685d4-3f56-4747-9d0b-795ec5ae24d6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:07.919590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:08.000232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 18/35] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:08.001949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70ed7-23f6-4b9d-b769-333757b4c5ab None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.002823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70ed7-23f6-4b9d-b769-333757b4c5ab None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.003113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70ed7-23f6-4b9d-b769-333757b4c5ab None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.004964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:08.010794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865815-31b1-49ee-8888-a9d7a970ab51 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.011087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865815-31b1-49ee-8888-a9d7a970ab51 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.011377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865815-31b1-49ee-8888-a9d7a970ab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.032414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-46865815-31b1-49ee-8888-a9d7a970ab51 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:08.034294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-46865815-31b1-49ee-8888-a9d7a970ab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:08.064809 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1685d4-3f56-4747-9d0b-795ec5ae24d6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:08.121531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d7675-140a-4432-954e-3dcc31eadff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:08.121531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d7675-140a-4432-954e-3dcc31eadff1 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.121770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d7675-140a-4432-954e-3dcc31eadff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.123376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d7675-140a-4432-954e-3dcc31eadff1 None admin] PATH_INFO: `/v3/domains/default/users/35a1bb04fdb644fe910032efa086d057/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.126811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d7675-140a-4432-954e-3dcc31eadff1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=35a1bb04fdb644fe910032efa086d057, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:08.128885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d7675-140a-4432-954e-3dcc31eadff1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:08.133788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 20/37] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:08.134658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46865815-31b1-49ee-8888-a9d7a970ab51 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:08.147160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 18/38] 10.222.0.79 () {58 vars in 1361 bytes} [Fri May 27 09:22:07 2022] PUT /identity/v3/domains/default/users/35a1bb04fdb644fe910032efa086d057/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:08.165006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d7675-140a-4432-954e-3dcc31eadff1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:08.233129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:08.258420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:08.266546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46865815-31b1-49ee-8888-a9d7a970ab51 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:08.303654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d7675-140a-4432-954e-3dcc31eadff1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:08.308189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d75b5b-c36d-43c5-8343-756dda9cb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:08.309374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d75b5b-c36d-43c5-8343-756dda9cb67a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.309872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d75b5b-c36d-43c5-8343-756dda9cb67a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.310356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d75b5b-c36d-43c5-8343-756dda9cb67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.322927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d75b5b-c36d-43c5-8343-756dda9cb67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:08.325125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d75b5b-c36d-43c5-8343-756dda9cb67a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:08.345889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb50111-7fca-4d5c-8219-df7c8c086534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c9d75b5b-c36d-43c5-8343-756dda9cb67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:22:08.346524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:08.347350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:08.348163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:22:08.348163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:22:08.348163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:22:08.348163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:08.348379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb50111-7fca-4d5c-8219-df7c8c086534 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.348379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb50111-7fca-4d5c-8219-df7c8c086534 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.348379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb50111-7fca-4d5c-8219-df7c8c086534 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.348545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 21/39] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:08.349494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef05b-0d76-4827-9041-bd53de4c76ca None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.349494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef05b-0d76-4827-9041-bd53de4c76ca None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.349661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef05b-0d76-4827-9041-bd53de4c76ca None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.352129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 22/40] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:08.353821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb50111-7fca-4d5c-8219-df7c8c086534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:08.355314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb50111-7fca-4d5c-8219-df7c8c086534 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:08.358072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5425f-18c4-4e5b-b854-63fb2d2d3d95 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.358184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 19/41] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:08.358268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5425f-18c4-4e5b-b854-63fb2d2d3d95 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.358268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5425f-18c4-4e5b-b854-63fb2d2d3d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.361773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb50111-7fca-4d5c-8219-df7c8c086534 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:08.378832 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4ff5425f-18c4-4e5b-b854-63fb2d2d3d95 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:08.379972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4ff5425f-18c4-4e5b-b854-63fb2d2d3d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:08.457004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 23/42] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:08.458265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5425f-18c4-4e5b-b854-63fb2d2d3d95 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:08.476707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb50111-7fca-4d5c-8219-df7c8c086534 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:08.501587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:08.519878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:08.520563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.520877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.521200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.521949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:08.522264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:08.523657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:08.541292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 20/43] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:08.542007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:08.558830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:08.584941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5425f-18c4-4e5b-b854-63fb2d2d3d95 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:08.622641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9487-09d7-49f7-8b4d-c6f232db51a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:08.623426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9487-09d7-49f7-8b4d-c6f232db51a0 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.623716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9487-09d7-49f7-8b4d-c6f232db51a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.623998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9487-09d7-49f7-8b4d-c6f232db51a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.624854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb9487-09d7-49f7-8b4d-c6f232db51a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:08.626328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb9487-09d7-49f7-8b4d-c6f232db51a0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:08.645867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864df54-2bfc-4d0d-a2cc-51233d28232f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:08.657633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 24/44] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:22:08 2022] POST /identity/v3/projects => generated 312 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:08.658784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9487-09d7-49f7-8b4d-c6f232db51a0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:08.700553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f7b45-a8c4-4153-887e-a34eb0816e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:08.702216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f7b45-a8c4-4153-887e-a34eb0816e58 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.702665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f7b45-a8c4-4153-887e-a34eb0816e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.703098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f7b45-a8c4-4153-887e-a34eb0816e58 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.704252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f7b45-a8c4-4153-887e-a34eb0816e58 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:08.706528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f7b45-a8c4-4153-887e-a34eb0816e58 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:08.725924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 21/45] 10.222.0.79 () {60 vars in 1131 bytes} [Fri May 27 09:22:08 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:08.796782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9487-09d7-49f7-8b4d-c6f232db51a0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:08.829992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:08.840014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f22dc1-7354-458e-b260-99c343fcb551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:08.840764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22dc1-7354-458e-b260-99c343fcb551 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:08.841093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22dc1-7354-458e-b260-99c343fcb551 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:08.841383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22dc1-7354-458e-b260-99c343fcb551 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:08.842148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f22dc1-7354-458e-b260-99c343fcb551 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:08.843956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f22dc1-7354-458e-b260-99c343fcb551 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:08.876234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 25/46] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:22:08 2022] POST /identity/v3/projects => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:10.382777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0745c5-5842-4001-a919-22175238f4b1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:10.383280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0745c5-5842-4001-a919-22175238f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:10.383360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0745c5-5842-4001-a919-22175238f4b1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:10.384720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 22/47] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:10.389858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3df02-5622-4fb6-9358-326b2f25369b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:10.390242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3df02-5622-4fb6-9358-326b2f25369b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:10.390543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3df02-5622-4fb6-9358-326b2f25369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:10.407486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c3e3df02-5622-4fb6-9358-326b2f25369b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:10.409180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c3e3df02-5622-4fb6-9358-326b2f25369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:10.473917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 26/48] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:10.497238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0745c5-5842-4001-a919-22175238f4b1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:10.543463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:10.602186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0745c5-5842-4001-a919-22175238f4b1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:10.634298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1885-4d1b-43c1-9ee9-aa0b0423de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:10.635089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1885-4d1b-43c1-9ee9-aa0b0423de32 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:10.635376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1885-4d1b-43c1-9ee9-aa0b0423de32 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:10.635655 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1885-4d1b-43c1-9ee9-aa0b0423de32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:10.646256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a1885-4d1b-43c1-9ee9-aa0b0423de32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f33a1885-4d1b-43c1-9ee9-aa0b0423de32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:10.653815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:10.654692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:10.655485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 23/49] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:10.660900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3df02-5622-4fb6-9358-326b2f25369b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:10.759902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3df02-5622-4fb6-9358-326b2f25369b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:10.770772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:10.794632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1124f3-3e07-43b8-aa22-932a967499e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:10.795310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1124f3-3e07-43b8-aa22-932a967499e3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:10.795594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1124f3-3e07-43b8-aa22-932a967499e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:10.795870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1124f3-3e07-43b8-aa22-932a967499e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:10.796610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1124f3-3e07-43b8-aa22-932a967499e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:10.796950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1124f3-3e07-43b8-aa22-932a967499e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:10.798328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1124f3-3e07-43b8-aa22-932a967499e3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:10.810275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 27/50] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:10.816290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1885-4d1b-43c1-9ee9-aa0b0423de32 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:10.913876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1885-4d1b-43c1-9ee9-aa0b0423de32 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:10.915335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:10.918046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6c7b-415b-4120-bc16-ca6523699b98 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:10.918355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6c7b-415b-4120-bc16-ca6523699b98 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:10.918651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6c7b-415b-4120-bc16-ca6523699b98 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:10.920028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 28/51] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:10.925696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1e5d8-f716-4641-989d-44c76c9f28d7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:10.926097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1e5d8-f716-4641-989d-44c76c9f28d7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:10.926376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1e5d8-f716-4641-989d-44c76c9f28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:10.944247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-64b1e5d8-f716-4641-989d-44c76c9f28d7 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:10.945457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-64b1e5d8-f716-4641-989d-44c76c9f28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:10.949131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744b420-dfab-452d-80f7-d5ecadeb1918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:10.950005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744b420-dfab-452d-80f7-d5ecadeb1918 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:10.950297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744b420-dfab-452d-80f7-d5ecadeb1918 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:10.950582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744b420-dfab-452d-80f7-d5ecadeb1918 None admin] PATH_INFO: `/v3/users/35a1bb04fdb644fe910032efa086d057` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:10.951795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744b420-dfab-452d-80f7-d5ecadeb1918 None admin] RBAC: Authorizing `identity:get_user(user_id=35a1bb04fdb644fe910032efa086d057)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:10.953290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744b420-dfab-452d-80f7-d5ecadeb1918 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:10.954926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 24/52] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:10 2022] GET /identity/v3/users/35a1bb04fdb644fe910032efa086d057 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:10.960159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744b420-dfab-452d-80f7-d5ecadeb1918 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:11.011016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 29/53] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:11.034490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1e5d8-f716-4641-989d-44c76c9f28d7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:11.058179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744b420-dfab-452d-80f7-d5ecadeb1918 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:11.093075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a25f44-e924-49c1-9bd2-3a43e59e7fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:11.093874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25f44-e924-49c1-9bd2-3a43e59e7fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:11.094159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25f44-e924-49c1-9bd2-3a43e59e7fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:11.094444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25f44-e924-49c1-9bd2-3a43e59e7fe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:11.095623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a25f44-e924-49c1-9bd2-3a43e59e7fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:11.097672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a25f44-e924-49c1-9bd2-3a43e59e7fe7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:11.099286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 25/54] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:11.105074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a25f44-e924-49c1-9bd2-3a43e59e7fe7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:11.131510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1e5d8-f716-4641-989d-44c76c9f28d7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:11.133033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:11.143724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:11.166215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07493-ceb6-4c2d-a7fd-390bb4678825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:11.166945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07493-ceb6-4c2d-a7fd-390bb4678825 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:11.167229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07493-ceb6-4c2d-a7fd-390bb4678825 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:11.167525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07493-ceb6-4c2d-a7fd-390bb4678825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:11.168689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c07493-ceb6-4c2d-a7fd-390bb4678825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:11.170179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c07493-ceb6-4c2d-a7fd-390bb4678825 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:11.171795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 30/55] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:11.177853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07493-ceb6-4c2d-a7fd-390bb4678825 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:11.202611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a25f44-e924-49c1-9bd2-3a43e59e7fe7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:11.235836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d31235-6156-4afc-8ac0-da733ca115ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:11.236525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31235-6156-4afc-8ac0-da733ca115ec None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:11.237342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31235-6156-4afc-8ac0-da733ca115ec None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:11.237626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31235-6156-4afc-8ac0-da733ca115ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:11.238459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d31235-6156-4afc-8ac0-da733ca115ec None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.domain.id=default, user.id=35a1bb04fdb644fe910032efa086d057) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:11.238772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d31235-6156-4afc-8ac0-da733ca115ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:11.240213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d31235-6156-4afc-8ac0-da733ca115ec None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:11.246026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 26/56] 10.222.0.79 () {56 vars in 1322 bytes} [Fri May 27 09:22:11 2022] GET /identity/v3/role_assignments?user.id=35a1bb04fdb644fe910032efa086d057&scope.domain.id=default&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:11.275501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07493-ceb6-4c2d-a7fd-390bb4678825 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:11.313436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1637-3007-4d3a-b7fd-f86d9c823bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:11.314124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1637-3007-4d3a-b7fd-f86d9c823bd4 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:11.314413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1637-3007-4d3a-b7fd-f86d9c823bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:11.314735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1637-3007-4d3a-b7fd-f86d9c823bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:11.315465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1637-3007-4d3a-b7fd-f86d9c823bd4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:11.316961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1637-3007-4d3a-b7fd-f86d9c823bd4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:11.345133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 31/57] 10.222.0.79 () {60 vars in 1140 bytes} [Fri May 27 09:22:11 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:22:13.511862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380d9d3-9054-4c3a-b8e9-a0b5def92d04 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:13.512369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380d9d3-9054-4c3a-b8e9-a0b5def92d04 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:13.512478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380d9d3-9054-4c3a-b8e9-a0b5def92d04 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:13.513848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 27/58] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:13.519721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d856-7bf2-42fe-8ab8-c5b1cb3a319f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:13.520081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d856-7bf2-42fe-8ab8-c5b1cb3a319f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:13.520293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d856-7bf2-42fe-8ab8-c5b1cb3a319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:13.536699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b996d856-7bf2-42fe-8ab8-c5b1cb3a319f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:13.537912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b996d856-7bf2-42fe-8ab8-c5b1cb3a319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:13.553709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:13.602487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 32/59] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:13.626365 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380d9d3-9054-4c3a-b8e9-a0b5def92d04 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:13.726852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380d9d3-9054-4c3a-b8e9-a0b5def92d04 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:13.728331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:13.761457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743245e-391b-48a9-b12a-9d3d19eac240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:13.762239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743245e-391b-48a9-b12a-9d3d19eac240 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:13.762526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743245e-391b-48a9-b12a-9d3d19eac240 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:13.762808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743245e-391b-48a9-b12a-9d3d19eac240 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:13.763961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743245e-391b-48a9-b12a-9d3d19eac240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:13.765445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743245e-391b-48a9-b12a-9d3d19eac240 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:13.767053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 28/60] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:13.772622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996d856-7bf2-42fe-8ab8-c5b1cb3a319f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:13.868373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996d856-7bf2-42fe-8ab8-c5b1cb3a319f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:13.901594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe240481-0ecc-472c-82aa-12f674418c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:13.902253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240481-0ecc-472c-82aa-12f674418c3f None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:13.902541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240481-0ecc-472c-82aa-12f674418c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:13.902981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240481-0ecc-472c-82aa-12f674418c3f None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:13.903839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe240481-0ecc-472c-82aa-12f674418c3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:13.905316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe240481-0ecc-472c-82aa-12f674418c3f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:13.933646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 33/61] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:22:13 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:17.285789 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443700-b5ce-4a0e-ae5b-be87d4e0b30e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.286361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443700-b5ce-4a0e-ae5b-be87d4e0b30e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.286361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443700-b5ce-4a0e-ae5b-be87d4e0b30e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.288065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 29/62] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:17.302991 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39616a-d198-456c-8063-7b81d0f6f86a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.303404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39616a-d198-456c-8063-7b81d0f6f86a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.303570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39616a-d198-456c-8063-7b81d0f6f86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.315146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5efeef-d845-4048-9167-da13f7efb094 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.315780 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5efeef-d845-4048-9167-da13f7efb094 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.316254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5efeef-d845-4048-9167-da13f7efb094 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.318114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 30/63] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:17.322708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad89ac-f528-45ab-8d2f-163d970356f3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.323214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad89ac-f528-45ab-8d2f-163d970356f3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.323689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad89ac-f528-45ab-8d2f-163d970356f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.342863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ad39616a-d198-456c-8063-7b81d0f6f86a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:17.344586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ad39616a-d198-456c-8063-7b81d0f6f86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:17.350124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:17.350793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eaad89ac-f528-45ab-8d2f-163d970356f3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:17.352272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eaad89ac-f528-45ab-8d2f-163d970356f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:17.471619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 31/64] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:17.489124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f143ab-d2ed-4d0e-822f-f2b394818a4c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.489432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f143ab-d2ed-4d0e-822f-f2b394818a4c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.489709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f143ab-d2ed-4d0e-822f-f2b394818a4c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.491345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 32/65] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:17.492275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f143ab-d2ed-4d0e-822f-f2b394818a4c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:17.496965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 34/66] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:17.498137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c304-e523-45ff-acde-4d294d103e29 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.498424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c304-e523-45ff-acde-4d294d103e29 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.498902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c304-e523-45ff-acde-4d294d103e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.528359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7dd9c304-e523-45ff-acde-4d294d103e29 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:17.529587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7dd9c304-e523-45ff-acde-4d294d103e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:17.616494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:17.622145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f143ab-d2ed-4d0e-822f-f2b394818a4c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:17.622319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 35/67] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:17.623409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c304-e523-45ff-acde-4d294d103e29 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:17.663944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540621a2-809d-4b2f-a49a-4c48971a1d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:17.664802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540621a2-809d-4b2f-a49a-4c48971a1d38 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.665126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540621a2-809d-4b2f-a49a-4c48971a1d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.665415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540621a2-809d-4b2f-a49a-4c48971a1d38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.676289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540621a2-809d-4b2f-a49a-4c48971a1d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-540621a2-809d-4b2f-a49a-4c48971a1d38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:17.683969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:17.685051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:17.686347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 33/68] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:17.687028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9159d8-8550-45c6-be50-7b15fb503ccd None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.687028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9159d8-8550-45c6-be50-7b15fb503ccd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.687028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9159d8-8550-45c6-be50-7b15fb503ccd None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.693151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 34/69] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:17.693151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9159d8-8550-45c6-be50-7b15fb503ccd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:17.708665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:17.746611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c304-e523-45ff-acde-4d294d103e29 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:17.782071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129b15a-bd34-42b6-b4e9-208b498ba66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:17.783679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b15a-bd34-42b6-b4e9-208b498ba66a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.784111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b15a-bd34-42b6-b4e9-208b498ba66a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.784535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b15a-bd34-42b6-b4e9-208b498ba66a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.799537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129b15a-bd34-42b6-b4e9-208b498ba66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2129b15a-bd34-42b6-b4e9-208b498ba66a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:17.809111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:17.810244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:17.811134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:17.813303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 36/70] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:17.814373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129b15a-bd34-42b6-b4e9-208b498ba66a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:17.820050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9159d8-8550-45c6-be50-7b15fb503ccd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:17.855887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550e7ee-1405-49e3-a779-658525506954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:17.857142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550e7ee-1405-49e3-a779-658525506954 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.857433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550e7ee-1405-49e3-a779-658525506954 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.857712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550e7ee-1405-49e3-a779-658525506954 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.869216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550e7ee-1405-49e3-a779-658525506954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3550e7ee-1405-49e3-a779-658525506954 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:17.877274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:17.878148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:17.878940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:17.883437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:22:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:17.884665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeda1c-9fea-4378-a746-249a22710484 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.884992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeda1c-9fea-4378-a746-249a22710484 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.885288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeda1c-9fea-4378-a746-249a22710484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.901858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-48aeda1c-9fea-4378-a746-249a22710484 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:17.903061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-48aeda1c-9fea-4378-a746-249a22710484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:17.918142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:17.927605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129b15a-bd34-42b6-b4e9-208b498ba66a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:17.953835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:17.963290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:17.964242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:17.964537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:17.964819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:17.965756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:17.966389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:17.968239 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:17.976940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 36/72] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:17.978020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeda1c-9fea-4378-a746-249a22710484 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:17.978576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 37/73] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:17.979457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.079710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4365f7-537d-495e-964d-ae22eab0502f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.084097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeda1c-9fea-4378-a746-249a22710484 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.113623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.114291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.114586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.114872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.115623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:18.115940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.117376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.117925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a94d20-3b7a-4340-b967-bb7d45c4e37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.118623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94d20-3b7a-4340-b967-bb7d45c4e37b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.118909 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94d20-3b7a-4340-b967-bb7d45c4e37b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.119196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94d20-3b7a-4340-b967-bb7d45c4e37b None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.119997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a94d20-3b7a-4340-b967-bb7d45c4e37b None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:18.120279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a94d20-3b7a-4340-b967-bb7d45c4e37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.121675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a94d20-3b7a-4340-b967-bb7d45c4e37b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.125225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 38/74] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:22:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:18.126020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.134234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 37/75] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:18.134234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f9db-ade6-4709-ac7a-a52223c105b6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.134234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f9db-ade6-4709-ac7a-a52223c105b6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.134234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f9db-ade6-4709-ac7a-a52223c105b6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.134234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 38/76] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:18.134234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95f9db-ade6-4709-ac7a-a52223c105b6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.149538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:18.180064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:18.226103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17059e-e9f3-4024-bd48-421b84e40678 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.235770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95f9db-ade6-4709-ac7a-a52223c105b6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.258203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334598c9-688c-4b92-80e8-00ed6036e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.259084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334598c9-688c-4b92-80e8-00ed6036e3be None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.259377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334598c9-688c-4b92-80e8-00ed6036e3be None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.259662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334598c9-688c-4b92-80e8-00ed6036e3be None admin] PATH_INFO: `/v3/users/35a1bb04fdb644fe910032efa086d057` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.260920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334598c9-688c-4b92-80e8-00ed6036e3be None admin] RBAC: Authorizing `identity:get_user(user_id=35a1bb04fdb644fe910032efa086d057)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.262368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334598c9-688c-4b92-80e8-00ed6036e3be None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.264016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 39/77] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/users/35a1bb04fdb644fe910032efa086d057 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:18.264780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334598c9-688c-4b92-80e8-00ed6036e3be None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.272118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094b2ac-fa1b-4ba7-8576-9ef28ca55e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.272956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094b2ac-fa1b-4ba7-8576-9ef28ca55e94 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.273244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094b2ac-fa1b-4ba7-8576-9ef28ca55e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.273520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094b2ac-fa1b-4ba7-8576-9ef28ca55e94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.284069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094b2ac-fa1b-4ba7-8576-9ef28ca55e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f094b2ac-fa1b-4ba7-8576-9ef28ca55e94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:18.291567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:18.293008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 39/78] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:18.293935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094b2ac-fa1b-4ba7-8576-9ef28ca55e94 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.366273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:18.367231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334598c9-688c-4b92-80e8-00ed6036e3be None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.386486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:18.396701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094b2ac-fa1b-4ba7-8576-9ef28ca55e94 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.400902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0faa1f7-89b0-463b-b31b-76637ace2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.401786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faa1f7-89b0-463b-b31b-76637ace2067 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.402079 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faa1f7-89b0-463b-b31b-76637ace2067 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.402365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faa1f7-89b0-463b-b31b-76637ace2067 None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.417642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0faa1f7-89b0-463b-b31b-76637ace2067 None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.419109 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0faa1f7-89b0-463b-b31b-76637ace2067 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.420777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 40/79] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:18.421974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0307e46-6bfa-4be0-ab7d-489ac31e2e71 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.422271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0307e46-6bfa-4be0-ab7d-489ac31e2e71 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.422556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0307e46-6bfa-4be0-ab7d-489ac31e2e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.429743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cb23d-f37d-4eac-8ffe-5afc25977924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.430610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb23d-f37d-4eac-8ffe-5afc25977924 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.430896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb23d-f37d-4eac-8ffe-5afc25977924 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.431175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb23d-f37d-4eac-8ffe-5afc25977924 None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.432372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cb23d-f37d-4eac-8ffe-5afc25977924 None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.433845 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cb23d-f37d-4eac-8ffe-5afc25977924 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.435599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 40/80] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:18.436198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cb23d-f37d-4eac-8ffe-5afc25977924 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.440853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f0307e46-6bfa-4be0-ab7d-489ac31e2e71 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:18.442065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f0307e46-6bfa-4be0-ab7d-489ac31e2e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:18.507263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 41/81] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:18.508101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0307e46-6bfa-4be0-ab7d-489ac31e2e71 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.539706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cb23d-f37d-4eac-8ffe-5afc25977924 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.572249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9b779-d925-4690-a7a2-5179beef2af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.573014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b779-d925-4690-a7a2-5179beef2af3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.573309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b779-d925-4690-a7a2-5179beef2af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.573591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b779-d925-4690-a7a2-5179beef2af3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.584415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:18.607269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0307e46-6bfa-4be0-ab7d-489ac31e2e71 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.616368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:18.641010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9b779-d925-4690-a7a2-5179beef2af3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.643014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9b779-d925-4690-a7a2-5179beef2af3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.643773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.644440 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.644748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.645033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.645780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:18.646085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.647440 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.655319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 42/82] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:18.656238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.742360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 41/83] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:18.743206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9b779-d925-4690-a7a2-5179beef2af3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.756758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf416-22a1-4f53-a23e-013a88542545 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.783999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:18.790229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd25a4-3554-48cc-9eea-0ba8bb2d633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.790882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd25a4-3554-48cc-9eea-0ba8bb2d633f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.791169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd25a4-3554-48cc-9eea-0ba8bb2d633f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.791450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd25a4-3554-48cc-9eea-0ba8bb2d633f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.829649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:18.841135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9b779-d925-4690-a7a2-5179beef2af3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:18.858231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd25a4-3554-48cc-9eea-0ba8bb2d633f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.859711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd25a4-3554-48cc-9eea-0ba8bb2d633f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.873758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2c6b-7e90-42c3-9291-d364e3dc14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:18.874405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2c6b-7e90-42c3-9291-d364e3dc14cd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:18.874695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2c6b-7e90-42c3-9291-d364e3dc14cd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:18.874985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2c6b-7e90-42c3-9291-d364e3dc14cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:18.941714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2c6b-7e90-42c3-9291-d364e3dc14cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:18.943139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2c6b-7e90-42c3-9291-d364e3dc14cd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:18.955758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 43/84] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:18.956586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd25a4-3554-48cc-9eea-0ba8bb2d633f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:18.983078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.023981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.040182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 42/85] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:19.041235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2c6b-7e90-42c3-9291-d364e3dc14cd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.056874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd25a4-3554-48cc-9eea-0ba8bb2d633f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.090978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a09f3-b77e-47f1-a1bb-e2b9adca626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.091765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a09f3-b77e-47f1-a1bb-e2b9adca626b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.092053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a09f3-b77e-47f1-a1bb-e2b9adca626b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.092336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a09f3-b77e-47f1-a1bb-e2b9adca626b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.093535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a09f3-b77e-47f1-a1bb-e2b9adca626b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.094995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a09f3-b77e-47f1-a1bb-e2b9adca626b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.096621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 44/86] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:19.097420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a09f3-b77e-47f1-a1bb-e2b9adca626b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.138983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2c6b-7e90-42c3-9291-d364e3dc14cd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.170664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eeafe-3ee2-4986-b2ee-67b40473807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.171530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eeafe-3ee2-4986-b2ee-67b40473807a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.171811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eeafe-3ee2-4986-b2ee-67b40473807a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.172088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eeafe-3ee2-4986-b2ee-67b40473807a None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.173288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7eeafe-3ee2-4986-b2ee-67b40473807a None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.175276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7eeafe-3ee2-4986-b2ee-67b40473807a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.181148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 43/87] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:19.181148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eeafe-3ee2-4986-b2ee-67b40473807a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.191958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.193855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a09f3-b77e-47f1-a1bb-e2b9adca626b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.226976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343159d2-146c-4917-9879-fc6f4296bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.227829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343159d2-146c-4917-9879-fc6f4296bb64 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.228111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343159d2-146c-4917-9879-fc6f4296bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.228386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343159d2-146c-4917-9879-fc6f4296bb64 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.229581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343159d2-146c-4917-9879-fc6f4296bb64 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.231024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343159d2-146c-4917-9879-fc6f4296bb64 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.232738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 45/88] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:19.233545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343159d2-146c-4917-9879-fc6f4296bb64 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.241846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.286800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eeafe-3ee2-4986-b2ee-67b40473807a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.322779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b5cfe-f632-4256-9e6e-52b6fe5e4a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.323634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5cfe-f632-4256-9e6e-52b6fe5e4a43 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.323919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5cfe-f632-4256-9e6e-52b6fe5e4a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.324196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5cfe-f632-4256-9e6e-52b6fe5e4a43 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.325410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b5cfe-f632-4256-9e6e-52b6fe5e4a43 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.326857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b5cfe-f632-4256-9e6e-52b6fe5e4a43 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.328548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 44/89] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:19.329306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b5cfe-f632-4256-9e6e-52b6fe5e4a43 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.334676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343159d2-146c-4917-9879-fc6f4296bb64 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.367575 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a86b09-bc91-488d-bc14-7487e283315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.368436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86b09-bc91-488d-bc14-7487e283315f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.368726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86b09-bc91-488d-bc14-7487e283315f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.369039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86b09-bc91-488d-bc14-7487e283315f None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.370223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a86b09-bc91-488d-bc14-7487e283315f None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.371664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a86b09-bc91-488d-bc14-7487e283315f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.373407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 46/90] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:19.374183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a86b09-bc91-488d-bc14-7487e283315f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.404505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.427267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b5cfe-f632-4256-9e6e-52b6fe5e4a43 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.448203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.462344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f0083-81cf-440e-88a0-f5a39f074bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.463013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0083-81cf-440e-88a0-f5a39f074bda None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.463296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0083-81cf-440e-88a0-f5a39f074bda None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.463573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0083-81cf-440e-88a0-f5a39f074bda None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.464286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f0083-81cf-440e-88a0-f5a39f074bda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.465740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f0083-81cf-440e-88a0-f5a39f074bda None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.473277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a86b09-bc91-488d-bc14-7487e283315f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.490490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 45/91] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:22:19 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:19.493712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f0083-81cf-440e-88a0-f5a39f074bda None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.511478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae82bf-7fa1-4ebd-90c6-ccb0f89a1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.512764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae82bf-7fa1-4ebd-90c6-ccb0f89a1209 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.513236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae82bf-7fa1-4ebd-90c6-ccb0f89a1209 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.513867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae82bf-7fa1-4ebd-90c6-ccb0f89a1209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.600970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae82bf-7fa1-4ebd-90c6-ccb0f89a1209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.602742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae82bf-7fa1-4ebd-90c6-ccb0f89a1209 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.608654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f0083-81cf-440e-88a0-f5a39f074bda None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.642277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.649830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.650703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.651012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.651642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.653078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=ad8175c8bdea405c88557743edcacad4, user.id=35a1bb04fdb644fe910032efa086d057) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:19.653729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.655708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.664897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 46/92] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/role_assignments?user.id=35a1bb04fdb644fe910032efa086d057&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:19.664897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.699610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.738556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 47/93] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:19.743686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae82bf-7fa1-4ebd-90c6-ccb0f89a1209 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.805773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4f63-003a-444d-aa52-8e5dd497d044 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.844006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.844681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.845000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.845281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.846167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] RBAC: Adding query filter params (role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=ad8175c8bdea405c88557743edcacad4, user.id=412029d6037c41d8ab5af5921aa4da34) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:19.846481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.847985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.856791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 47/94] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/role_assignments?user.id=412029d6037c41d8ab5af5921aa4da34&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:19.857677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:19.897285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae82bf-7fa1-4ebd-90c6-ccb0f89a1209 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:19.938076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:19.942692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:19.943466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:19.943761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:19.944052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:19.944941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] RBAC: Adding query filter params (role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=ad8175c8bdea405c88557743edcacad4, user.id=412029d6037c41d8ab5af5921aa4da34) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:19.945265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:19.946893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:19.956443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 48/95] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/role_assignments?user.id=412029d6037c41d8ab5af5921aa4da34&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:19.989811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeabd9-d312-4491-af3c-db709208bd8f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:20.044315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69973af8-734c-4cea-80b0-b9646ade9329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:20.045459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973af8-734c-4cea-80b0-b9646ade9329 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:20.045747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973af8-734c-4cea-80b0-b9646ade9329 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:20.046027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973af8-734c-4cea-80b0-b9646ade9329 None admin] PATH_INFO: `/v3/projects/56fd939c35bb4a888de5cbbbb6fd26cd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:20.047322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69973af8-734c-4cea-80b0-b9646ade9329 None admin] RBAC: Authorizing `identity:get_project(project_id=56fd939c35bb4a888de5cbbbb6fd26cd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:20.049476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69973af8-734c-4cea-80b0-b9646ade9329 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:20.051563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 48/96] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:19 2022] GET /identity/v3/projects/56fd939c35bb4a888de5cbbbb6fd26cd => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:20.057474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:20.130973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:20.204428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886fea4-d0f3-43e5-84c2-6c923c46e129 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:20.242163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c495154-2443-422c-9004-534f24b6c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:20.242815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c495154-2443-422c-9004-534f24b6c5dc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:20.243105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c495154-2443-422c-9004-534f24b6c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:20.243390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c495154-2443-422c-9004-534f24b6c5dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:20.244313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c495154-2443-422c-9004-534f24b6c5dc None admin] RBAC: Adding query filter params (role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=56fd939c35bb4a888de5cbbbb6fd26cd, user.id=412029d6037c41d8ab5af5921aa4da34) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:20.244638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c495154-2443-422c-9004-534f24b6c5dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:20.246183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c495154-2443-422c-9004-534f24b6c5dc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:20.252982 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 49/97] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:20 2022] GET /identity/v3/role_assignments?user.id=412029d6037c41d8ab5af5921aa4da34&scope.project.id=56fd939c35bb4a888de5cbbbb6fd26cd&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:22.676614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9774fe-e90c-49f7-8a2d-04bfc453f029 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:22.677478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9774fe-e90c-49f7-8a2d-04bfc453f029 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:22.677904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9774fe-e90c-49f7-8a2d-04bfc453f029 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:22.679704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 49/98] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:22.685324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674ee4e-2e5f-42c3-88d2-0c2a49ce880a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:22.685736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674ee4e-2e5f-42c3-88d2-0c2a49ce880a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:22.686080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674ee4e-2e5f-42c3-88d2-0c2a49ce880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:22.706785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1674ee4e-2e5f-42c3-88d2-0c2a49ce880a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:22.707995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1674ee4e-2e5f-42c3-88d2-0c2a49ce880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:22.797541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 50/99] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:22.828224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9774fe-e90c-49f7-8a2d-04bfc453f029 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:22.849027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d913e7-b4eb-4385-ad39-b071bef86fd6 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:22.849562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d913e7-b4eb-4385-ad39-b071bef86fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:22.850062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d913e7-b4eb-4385-ad39-b071bef86fd6 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:22.851666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 51/100] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:22.859464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b8c28-ded5-4dd7-948d-eda3e47aa348 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:22.860002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b8c28-ded5-4dd7-948d-eda3e47aa348 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:22.860483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b8c28-ded5-4dd7-948d-eda3e47aa348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:22.897809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-511b8c28-ded5-4dd7-948d-eda3e47aa348 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:22.899373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-511b8c28-ded5-4dd7-948d-eda3e47aa348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:22.935293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:23.005104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 52/101] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:23.006357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e6f3-8908-44ca-a411-c25268c7b343 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.006582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e6f3-8908-44ca-a411-c25268c7b343 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.006864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e6f3-8908-44ca-a411-c25268c7b343 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.012286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 53/102] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:23.013523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ea3c2-6307-4cc5-993c-490256d61d1a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.013816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ea3c2-6307-4cc5-993c-490256d61d1a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.014098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ea3c2-6307-4cc5-993c-490256d61d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.043827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9774fe-e90c-49f7-8a2d-04bfc453f029 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:23.050432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f90ea3c2-6307-4cc5-993c-490256d61d1a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:23.051656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f90ea3c2-6307-4cc5-993c-490256d61d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:23.082791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:23.097527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ebb0-93ef-4a7f-a831-13ec1590d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:23.099604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ebb0-93ef-4a7f-a831-13ec1590d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.100179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ebb0-93ef-4a7f-a831-13ec1590d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.100713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ebb0-93ef-4a7f-a831-13ec1590d5a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.115752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84ebb0-93ef-4a7f-a831-13ec1590d5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1e84ebb0-93ef-4a7f-a831-13ec1590d5a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:23.124140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:23.125084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:23.125878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:23.128338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 50/103] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:23.129629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ebb0-93ef-4a7f-a831-13ec1590d5a9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.207988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 54/104] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:23.207988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ea3c2-6307-4cc5-993c-490256d61d1a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.267347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ebb0-93ef-4a7f-a831-13ec1590d5a9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:23.320741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809613a3-0116-476f-a9a2-2375bbd354f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:23.322331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809613a3-0116-476f-a9a2-2375bbd354f5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.322879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809613a3-0116-476f-a9a2-2375bbd354f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.323374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809613a3-0116-476f-a9a2-2375bbd354f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.328394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:23.339549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ea3c2-6307-4cc5-993c-490256d61d1a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:23.340817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809613a3-0116-476f-a9a2-2375bbd354f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-809613a3-0116-476f-a9a2-2375bbd354f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:23.355687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:23.356626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:23.357431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:23.360080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 51/105] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:22:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:23.362401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2f3f5-15d2-4411-baa6-a6e7a05d4b5d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.362916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2f3f5-15d2-4411-baa6-a6e7a05d4b5d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.363457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2f3f5-15d2-4411-baa6-a6e7a05d4b5d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.365012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 52/106] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:23.366191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2f3f5-15d2-4411-baa6-a6e7a05d4b5d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.378558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:23.379260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.379930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.380214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.381055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:23.381367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:23.383769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:23.394702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 55/107] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:23.395751 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.424755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:23.490337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2f3f5-15d2-4411-baa6-a6e7a05d4b5d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:23.521599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5489-8815-45e0-9fba-505511cce961 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:23.525977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898207c4-0816-4220-ac94-b44356b424be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:23.526798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898207c4-0816-4220-ac94-b44356b424be None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.527085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898207c4-0816-4220-ac94-b44356b424be None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.527367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898207c4-0816-4220-ac94-b44356b424be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.528620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898207c4-0816-4220-ac94-b44356b424be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:23.530189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898207c4-0816-4220-ac94-b44356b424be None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:23.531929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 53/108] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:23.537192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4798-b0e4-4b59-a548-a7fc6391938f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.537192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4798-b0e4-4b59-a548-a7fc6391938f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.537192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4798-b0e4-4b59-a548-a7fc6391938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.554170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a02c4798-b0e4-4b59-a548-a7fc6391938f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:23.555536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a02c4798-b0e4-4b59-a548-a7fc6391938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:23.568419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:23.569150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.569440 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.569721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.570477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:23.570784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:23.572184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:23.581586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 56/109] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:22:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:23.582301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.604606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:23.628090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 54/110] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:23.637090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d735f-8f80-4acd-bb7c-e32931e094b2 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.637090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d735f-8f80-4acd-bb7c-e32931e094b2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.637090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d735f-8f80-4acd-bb7c-e32931e094b2 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.637090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 55/111] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:23.637090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d735f-8f80-4acd-bb7c-e32931e094b2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.684879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:23.704121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76483-6ccd-4edb-855e-42e9de8d84a8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:23.739584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d735f-8f80-4acd-bb7c-e32931e094b2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:23.740467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5db00-b370-4391-b91b-8bb9a1a3f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:23.741326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5db00-b370-4391-b91b-8bb9a1a3f7ab None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.741616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5db00-b370-4391-b91b-8bb9a1a3f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.741897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5db00-b370-4391-b91b-8bb9a1a3f7ab None admin] PATH_INFO: `/v3/users/35a1bb04fdb644fe910032efa086d057` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.743101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5db00-b370-4391-b91b-8bb9a1a3f7ab None admin] RBAC: Authorizing `identity:get_user(user_id=35a1bb04fdb644fe910032efa086d057)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:23.744553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5db00-b370-4391-b91b-8bb9a1a3f7ab None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:23.746229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 57/112] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:23 2022] GET /identity/v3/users/35a1bb04fdb644fe910032efa086d057 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:23.747068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5db00-b370-4391-b91b-8bb9a1a3f7ab None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.774252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da03f9-beb1-4678-9969-5637981cf7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:23.774907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da03f9-beb1-4678-9969-5637981cf7dd None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.775190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da03f9-beb1-4678-9969-5637981cf7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.775467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da03f9-beb1-4678-9969-5637981cf7dd None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.776166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da03f9-beb1-4678-9969-5637981cf7dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:23.777632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da03f9-beb1-4678-9969-5637981cf7dd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:23.806152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 56/113] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:22:23 2022] POST /identity/v3/projects => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:23.806152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0a73-a10b-4f18-971b-b783a3c9a60b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.806152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0a73-a10b-4f18-971b-b783a3c9a60b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.806152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed0a73-a10b-4f18-971b-b783a3c9a60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.830950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c6ed0a73-a10b-4f18-971b-b783a3c9a60b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:23.832212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c6ed0a73-a10b-4f18-971b-b783a3c9a60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:23.851966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:23.871176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5db00-b370-4391-b91b-8bb9a1a3f7ab None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:23.916853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 57/114] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:23.916853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed0a73-a10b-4f18-971b-b783a3c9a60b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.918974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59f13-1230-440d-8080-b68d073d94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:23.919973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59f13-1230-440d-8080-b68d073d94f5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.920337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59f13-1230-440d-8080-b68d073d94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.920693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59f13-1230-440d-8080-b68d073d94f5 None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.922230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf59f13-1230-440d-8080-b68d073d94f5 None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:23.923880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf59f13-1230-440d-8080-b68d073d94f5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:23.925936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 58/115] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:23 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:23.927445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693df52c-cc35-4a77-b1c1-45a1d31e0e12 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:23.927837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693df52c-cc35-4a77-b1c1-45a1d31e0e12 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:23.928317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693df52c-cc35-4a77-b1c1-45a1d31e0e12 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:23.929963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 59/116] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:23.930860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693df52c-cc35-4a77-b1c1-45a1d31e0e12 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:23.950797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.038556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed0a73-a10b-4f18-971b-b783a3c9a60b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.051008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693df52c-cc35-4a77-b1c1-45a1d31e0e12 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.075147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460f126-7996-4204-92ef-55a853ea9d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.076185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460f126-7996-4204-92ef-55a853ea9d7c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.076481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460f126-7996-4204-92ef-55a853ea9d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.076766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460f126-7996-4204-92ef-55a853ea9d7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.088105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460f126-7996-4204-92ef-55a853ea9d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:24.090167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe45719-cd16-44f7-adba-cf2c5fbd40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.091233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe45719-cd16-44f7-adba-cf2c5fbd40e6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.091673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe45719-cd16-44f7-adba-cf2c5fbd40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.092100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe45719-cd16-44f7-adba-cf2c5fbd40e6 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.093469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe45719-cd16-44f7-adba-cf2c5fbd40e6 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:24.095082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe45719-cd16-44f7-adba-cf2c5fbd40e6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4460f126-7996-4204-92ef-55a853ea9d7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:24.095829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:24.096876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 58/117] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:24.102573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460f126-7996-4204-92ef-55a853ea9d7c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.103295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 60/118] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:23 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:24.103814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f999ca-a9d8-430a-a9b7-e357f18dcac4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.104344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f999ca-a9d8-430a-a9b7-e357f18dcac4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.104656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f999ca-a9d8-430a-a9b7-e357f18dcac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.122937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-66f999ca-a9d8-430a-a9b7-e357f18dcac4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:24.124107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-66f999ca-a9d8-430a-a9b7-e357f18dcac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:24.138662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.197048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.198120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 61/119] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:24.199066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f999ca-a9d8-430a-a9b7-e357f18dcac4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.213170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460f126-7996-4204-92ef-55a853ea9d7c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.249859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212100-ac16-4d5b-8ba6-416107b5fe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.250724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212100-ac16-4d5b-8ba6-416107b5fe86 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.251011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212100-ac16-4d5b-8ba6-416107b5fe86 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.251290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212100-ac16-4d5b-8ba6-416107b5fe86 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.253108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212100-ac16-4d5b-8ba6-416107b5fe86 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:24.254565 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212100-ac16-4d5b-8ba6-416107b5fe86 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:24.260866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 59/120] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:24.260866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212100-ac16-4d5b-8ba6-416107b5fe86 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.327169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f999ca-a9d8-430a-a9b7-e357f18dcac4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.364435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212100-ac16-4d5b-8ba6-416107b5fe86 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.364609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f450a-f3dd-4cc9-a013-a2295c0fbe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.365336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f450a-f3dd-4cc9-a013-a2295c0fbe03 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.365624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f450a-f3dd-4cc9-a013-a2295c0fbe03 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.365904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f450a-f3dd-4cc9-a013-a2295c0fbe03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.377690 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f450a-f3dd-4cc9-a013-a2295c0fbe03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1a5f450a-f3dd-4cc9-a013-a2295c0fbe03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:24.386035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:24.386911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:24.387685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 62/121] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:24.388343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f450a-f3dd-4cc9-a013-a2295c0fbe03 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.402326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.406940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.407627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.407988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.408786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.409557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:24.409875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:24.411312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:24.424308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 60/122] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:24.424308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.442652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.502463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f450a-f3dd-4cc9-a013-a2295c0fbe03 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.528066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d092ac7-3e39-4507-a5fa-ef20dc71a050 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.539297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070ad06-e0ce-4899-a45e-d1fdb2c1cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.540187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ad06-e0ce-4899-a45e-d1fdb2c1cf1d None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.540473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ad06-e0ce-4899-a45e-d1fdb2c1cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.540749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ad06-e0ce-4899-a45e-d1fdb2c1cf1d None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4/users/35a1bb04fdb644fe910032efa086d057/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.542956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070ad06-e0ce-4899-a45e-d1fdb2c1cf1d None admin] RBAC: Authorizing `identity:create_grant(project_id=ad8175c8bdea405c88557743edcacad4, user_id=35a1bb04fdb644fe910032efa086d057, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:24.544526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070ad06-e0ce-4899-a45e-d1fdb2c1cf1d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:24.569110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 63/123] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:24 2022] PUT /identity/v3/projects/ad8175c8bdea405c88557743edcacad4/users/35a1bb04fdb644fe910032efa086d057/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:24.569110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070ad06-e0ce-4899-a45e-d1fdb2c1cf1d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.572958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05bf2a-7bf9-44e7-94c5-7730891b10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.573810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05bf2a-7bf9-44e7-94c5-7730891b10c3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.574114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05bf2a-7bf9-44e7-94c5-7730891b10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.574385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05bf2a-7bf9-44e7-94c5-7730891b10c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.587561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05bf2a-7bf9-44e7-94c5-7730891b10c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0e05bf2a-7bf9-44e7-94c5-7730891b10c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:24.595541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:24.596497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 61/124] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:24.597821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05bf2a-7bf9-44e7-94c5-7730891b10c3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.676946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.694403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.719271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05bf2a-7bf9-44e7-94c5-7730891b10c3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.721602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070ad06-e0ce-4899-a45e-d1fdb2c1cf1d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.758287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.758527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306a553-12d0-4161-8e29-83b30f9b56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.759024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.759317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.759596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.760290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306a553-12d0-4161-8e29-83b30f9b56eb None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.760390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:24.760659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:24.761103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306a553-12d0-4161-8e29-83b30f9b56eb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.761572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306a553-12d0-4161-8e29-83b30f9b56eb None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4/users/412029d6037c41d8ab5af5921aa4da34/roles/5a932a8a65dd4faab8c58bcf29388fc7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.762099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:24.764315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306a553-12d0-4161-8e29-83b30f9b56eb None admin] RBAC: Authorizing `identity:create_grant(project_id=ad8175c8bdea405c88557743edcacad4, user_id=412029d6037c41d8ab5af5921aa4da34, role_id=5a932a8a65dd4faab8c58bcf29388fc7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:24.766032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306a553-12d0-4161-8e29-83b30f9b56eb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:24.776675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 62/125] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:24.776675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.788224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 64/126] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:24 2022] PUT /identity/v3/projects/ad8175c8bdea405c88557743edcacad4/users/412029d6037c41d8ab5af5921aa4da34/roles/5a932a8a65dd4faab8c58bcf29388fc7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:24.789696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306a553-12d0-4161-8e29-83b30f9b56eb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.894880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6bac-7b47-424f-84c2-91a4decda3c3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.916003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306a553-12d0-4161-8e29-83b30f9b56eb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:24.932396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe327d-d2ad-40d3-8993-f8941dec7293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.933133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe327d-d2ad-40d3-8993-f8941dec7293 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.933491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe327d-d2ad-40d3-8993-f8941dec7293 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.933853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe327d-d2ad-40d3-8993-f8941dec7293 None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.935214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe327d-d2ad-40d3-8993-f8941dec7293 None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:24.936867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe327d-d2ad-40d3-8993-f8941dec7293 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:24.938978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 63/127] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:24.940430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe327d-d2ad-40d3-8993-f8941dec7293 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:24.951404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.958646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:24.959713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:24.960179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:24.960626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:24.961734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:24.962598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:24.964320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:24.966505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:24.974176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 65/128] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:24.975375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:25.096362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e104ba-c518-4411-bdfd-4070e5db5061 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:25.098711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe327d-d2ad-40d3-8993-f8941dec7293 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:25.158266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc2bb-f058-4f61-9eb5-d1491e35c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:25.159069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc2bb-f058-4f61-9eb5-d1491e35c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:25.159353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc2bb-f058-4f61-9eb5-d1491e35c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:25.159634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc2bb-f058-4f61-9eb5-d1491e35c0a7 None admin] PATH_INFO: `/v3/projects/56fd939c35bb4a888de5cbbbb6fd26cd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:25.161226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafc2bb-f058-4f61-9eb5-d1491e35c0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=56fd939c35bb4a888de5cbbbb6fd26cd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:25.162684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafc2bb-f058-4f61-9eb5-d1491e35c0a7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:25.164396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 66/129] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/projects/56fd939c35bb4a888de5cbbbb6fd26cd => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:25.166289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650ffea-ee46-40ff-a836-238d8d83b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:25.167175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650ffea-ee46-40ff-a836-238d8d83b8dc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:25.167456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650ffea-ee46-40ff-a836-238d8d83b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:25.167736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650ffea-ee46-40ff-a836-238d8d83b8dc None admin] PATH_INFO: `/v3/users/2d6f596093464e32ad891ffeba14fe6d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:25.170561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc2bb-f058-4f61-9eb5-d1491e35c0a7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:25.192480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650ffea-ee46-40ff-a836-238d8d83b8dc None admin] RBAC: Authorizing `identity:get_user(user_id=2d6f596093464e32ad891ffeba14fe6d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:25.194016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650ffea-ee46-40ff-a836-238d8d83b8dc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:25.195910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 64/130] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:24 2022] GET /identity/v3/users/2d6f596093464e32ad891ffeba14fe6d => generated 289 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:25.200814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650ffea-ee46-40ff-a836-238d8d83b8dc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:25.285903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:25.301572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:25.335078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650ffea-ee46-40ff-a836-238d8d83b8dc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:25.371954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f385cd7-06d3-4a5f-b763-c53f63810ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:25.373242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f385cd7-06d3-4a5f-b763-c53f63810ec3 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:25.373723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f385cd7-06d3-4a5f-b763-c53f63810ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:25.374193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f385cd7-06d3-4a5f-b763-c53f63810ec3 None admin] PATH_INFO: `/v3/projects/56fd939c35bb4a888de5cbbbb6fd26cd/users/412029d6037c41d8ab5af5921aa4da34/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:25.376493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f385cd7-06d3-4a5f-b763-c53f63810ec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=56fd939c35bb4a888de5cbbbb6fd26cd, user_id=412029d6037c41d8ab5af5921aa4da34, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:25.378200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f385cd7-06d3-4a5f-b763-c53f63810ec3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:25.394807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 65/131] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:25 2022] PUT /identity/v3/projects/56fd939c35bb4a888de5cbbbb6fd26cd/users/412029d6037c41d8ab5af5921aa4da34/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:25.396217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f385cd7-06d3-4a5f-b763-c53f63810ec3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:25.416191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc2bb-f058-4f61-9eb5-d1491e35c0a7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:25.517260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f385cd7-06d3-4a5f-b763-c53f63810ec3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:25.530296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd111b9-8b2a-4770-9efc-f0053853a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:25.531188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd111b9-8b2a-4770-9efc-f0053853a588 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:25.531473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd111b9-8b2a-4770-9efc-f0053853a588 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:25.531752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd111b9-8b2a-4770-9efc-f0053853a588 None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:25.537691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd111b9-8b2a-4770-9efc-f0053853a588 None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:25.539212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd111b9-8b2a-4770-9efc-f0053853a588 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:25.541026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 67/132] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:25 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:25.546863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd111b9-8b2a-4770-9efc-f0053853a588 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:25.549645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:25.560382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408cf17-582b-46d0-a994-28f0ba63e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:25.561434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408cf17-582b-46d0-a994-28f0ba63e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:25.561938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408cf17-582b-46d0-a994-28f0ba63e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:25.562417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408cf17-582b-46d0-a994-28f0ba63e6c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:25.641504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408cf17-582b-46d0-a994-28f0ba63e6c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:25.643449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408cf17-582b-46d0-a994-28f0ba63e6c5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:25.762392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd111b9-8b2a-4770-9efc-f0053853a588 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:25.812386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:25.828801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647c81-443a-486e-ac34-4a5dcf033d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:25.830215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647c81-443a-486e-ac34-4a5dcf033d84 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:25.830508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647c81-443a-486e-ac34-4a5dcf033d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:25.831005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b647c81-443a-486e-ac34-4a5dcf033d84 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:25.833223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b647c81-443a-486e-ac34-4a5dcf033d84 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:25.835457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b647c81-443a-486e-ac34-4a5dcf033d84 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:25.837536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 68/133] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:25 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:25.843894 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647c81-443a-486e-ac34-4a5dcf033d84 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:25.851400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 66/134] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:25.861934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408cf17-582b-46d0-a994-28f0ba63e6c5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:25.903823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:26.029231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b647c81-443a-486e-ac34-4a5dcf033d84 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:26.032545 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408cf17-582b-46d0-a994-28f0ba63e6c5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:26.091758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d868a62-8eb2-4147-8921-74273b41d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:26.092666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868a62-8eb2-4147-8921-74273b41d7a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:26.092980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868a62-8eb2-4147-8921-74273b41d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:26.093265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868a62-8eb2-4147-8921-74273b41d7a2 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4/users/412029d6037c41d8ab5af5921aa4da34/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:26.096003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d868a62-8eb2-4147-8921-74273b41d7a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad8175c8bdea405c88557743edcacad4, user_id=412029d6037c41d8ab5af5921aa4da34, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:26.097502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d868a62-8eb2-4147-8921-74273b41d7a2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:26.100336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f3f2-6d0a-4f88-a76f-41d2661f3887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:26.101234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f3f2-6d0a-4f88-a76f-41d2661f3887 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:26.101518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f3f2-6d0a-4f88-a76f-41d2661f3887 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:26.101799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f3f2-6d0a-4f88-a76f-41d2661f3887 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:26.103146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f3f2-6d0a-4f88-a76f-41d2661f3887 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:26.104598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f3f2-6d0a-4f88-a76f-41d2661f3887 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:26.106328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 67/135] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:25 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:26.113213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f3f2-6d0a-4f88-a76f-41d2661f3887 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:26.128278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 69/136] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:25 2022] PUT /identity/v3/projects/ad8175c8bdea405c88557743edcacad4/users/412029d6037c41d8ab5af5921aa4da34/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:26.253290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:26.262034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f3f2-6d0a-4f88-a76f-41d2661f3887 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:26.318977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64c781-0374-499f-b066-50f2c50b618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:26.320037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64c781-0374-499f-b066-50f2c50b618c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:26.320548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64c781-0374-499f-b066-50f2c50b618c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:26.321085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64c781-0374-499f-b066-50f2c50b618c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:26.322133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64c781-0374-499f-b066-50f2c50b618c None admin] RBAC: Adding query filter params (role.id=42ddc037011a4faf942409f6f034415c, scope.project.id=ad8175c8bdea405c88557743edcacad4, user.id=2d6f596093464e32ad891ffeba14fe6d) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:26.322646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64c781-0374-499f-b066-50f2c50b618c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:26.324303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64c781-0374-499f-b066-50f2c50b618c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:26.331511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 68/137] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:26 2022] GET /identity/v3/role_assignments?user.id=2d6f596093464e32ad891ffeba14fe6d&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=42ddc037011a4faf942409f6f034415c => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:26.815256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a307943-5fad-4d35-85ca-99dd8ad1b08d None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:26.816018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a307943-5fad-4d35-85ca-99dd8ad1b08d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:26.816018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a307943-5fad-4d35-85ca-99dd8ad1b08d None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:26.817465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 70/138] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:26.834885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820dbd-8bd8-4bae-8262-538ed518277a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:26.835494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820dbd-8bd8-4bae-8262-538ed518277a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:26.835985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820dbd-8bd8-4bae-8262-538ed518277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:26.857821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d1820dbd-8bd8-4bae-8262-538ed518277a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:26.859781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d1820dbd-8bd8-4bae-8262-538ed518277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:26.948502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 69/139] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:26.981707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a307943-5fad-4d35-85ca-99dd8ad1b08d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:27.043032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:27.093632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a307943-5fad-4d35-85ca-99dd8ad1b08d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:27.141342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abebe9f-4f2b-4176-820a-8e0049783404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:27.142230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abebe9f-4f2b-4176-820a-8e0049783404 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:27.143031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abebe9f-4f2b-4176-820a-8e0049783404 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:27.143312 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abebe9f-4f2b-4176-820a-8e0049783404 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:27.144540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abebe9f-4f2b-4176-820a-8e0049783404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:27.146036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abebe9f-4f2b-4176-820a-8e0049783404 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:27.147666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 71/140] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:27.153465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820dbd-8bd8-4bae-8262-538ed518277a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:27.278733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:27.293697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820dbd-8bd8-4bae-8262-538ed518277a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:27.353144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80313d0-4a95-40a9-8aff-62a9187ab3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:27.353754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80313d0-4a95-40a9-8aff-62a9187ab3d0 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:27.354047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80313d0-4a95-40a9-8aff-62a9187ab3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:27.354332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80313d0-4a95-40a9-8aff-62a9187ab3d0 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:27.355052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80313d0-4a95-40a9-8aff-62a9187ab3d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:27.356528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80313d0-4a95-40a9-8aff-62a9187ab3d0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:27.385368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 70/141] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:22:27 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:27.681756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65902c-d9e9-43d6-a406-653d3a08fb70 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:27.682086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65902c-d9e9-43d6-a406-653d3a08fb70 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:27.682291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65902c-d9e9-43d6-a406-653d3a08fb70 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:27.683784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 72/142] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:27.689624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feacd8-5b22-4f15-824d-69a0cfec04c4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:27.690091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feacd8-5b22-4f15-824d-69a0cfec04c4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:27.690385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feacd8-5b22-4f15-824d-69a0cfec04c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:27.712348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-88feacd8-5b22-4f15-824d-69a0cfec04c4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:27.713594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-88feacd8-5b22-4f15-824d-69a0cfec04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:27.801803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 71/143] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:27.836680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65902c-d9e9-43d6-a406-653d3a08fb70 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:27.972082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65902c-d9e9-43d6-a406-653d3a08fb70 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:27.997632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:28.009859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d950-0372-4684-bf0e-7756c422eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:28.010982 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d950-0372-4684-bf0e-7756c422eff6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.011505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d950-0372-4684-bf0e-7756c422eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.011995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d950-0372-4684-bf0e-7756c422eff6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.024279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4d950-0372-4684-bf0e-7756c422eff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-4ab4d950-0372-4684-bf0e-7756c422eff6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:28.033469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:28.034513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:28.035296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:28.038088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 73/144] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:22:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:28.043612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feacd8-5b22-4f15-824d-69a0cfec04c4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:28.132597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f18f-c322-4ee1-95af-a78d2cfa2b1e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.133282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f18f-c322-4ee1-95af-a78d2cfa2b1e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.133771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f18f-c322-4ee1-95af-a78d2cfa2b1e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.135886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 74/145] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:28.148299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258335-0120-4ef0-a3bb-bb909ed805ee None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.148905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258335-0120-4ef0-a3bb-bb909ed805ee None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.149398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258335-0120-4ef0-a3bb-bb909ed805ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.164418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:28.175688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7f258335-0120-4ef0-a3bb-bb909ed805ee None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:28.178159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7f258335-0120-4ef0-a3bb-bb909ed805ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:28.231576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feacd8-5b22-4f15-824d-69a0cfec04c4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:28.273989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 75/146] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:28.302754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258335-0120-4ef0-a3bb-bb909ed805ee None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:28.307185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:28.307185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.307185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.307185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.307488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:28.307488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:28.308004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:28.317239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 72/147] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:22:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:28.322355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:28.460102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986598d7-a06b-4219-bb51-3952de334d76 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:28.506086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a29f95-213a-4f93-9870-d56e4a41dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:28.506898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29f95-213a-4f93-9870-d56e4a41dfaf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.507179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29f95-213a-4f93-9870-d56e4a41dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.507456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29f95-213a-4f93-9870-d56e4a41dfaf None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.509507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a29f95-213a-4f93-9870-d56e4a41dfaf None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:28.510983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a29f95-213a-4f93-9870-d56e4a41dfaf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:28.512912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 73/148] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:28 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:28.523785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258335-0120-4ef0-a3bb-bb909ed805ee None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:28.539680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a29f95-213a-4f93-9870-d56e4a41dfaf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:28.550928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:28.553822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:28.592159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ade6a-4f9d-4668-b1ea-9bc4b37bf7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:28.592992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ade6a-4f9d-4668-b1ea-9bc4b37bf7eb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.593656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ade6a-4f9d-4668-b1ea-9bc4b37bf7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.593936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ade6a-4f9d-4668-b1ea-9bc4b37bf7eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.617034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ade6a-4f9d-4668-b1ea-9bc4b37bf7eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a36ade6a-4f9d-4668-b1ea-9bc4b37bf7eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:28.629253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:28.630173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:28.630957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:28.636944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 76/149] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:28.641955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ade6a-4f9d-4668-b1ea-9bc4b37bf7eb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:28.733228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a29f95-213a-4f93-9870-d56e4a41dfaf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:28.804351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a06a68-26c6-43c5-a9a9-a17a833892cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:28.805480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06a68-26c6-43c5-a9a9-a17a833892cd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.805962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06a68-26c6-43c5-a9a9-a17a833892cd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.806434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06a68-26c6-43c5-a9a9-a17a833892cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.844275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ade6a-4f9d-4668-b1ea-9bc4b37bf7eb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:28.917228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a06a68-26c6-43c5-a9a9-a17a833892cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:28.919031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a06a68-26c6-43c5-a9a9-a17a833892cd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:28.923990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:28.929745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce1555-793c-405c-b68b-2e38c117714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:28.930450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce1555-793c-405c-b68b-2e38c117714d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.930742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce1555-793c-405c-b68b-2e38c117714d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.931030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce1555-793c-405c-b68b-2e38c117714d None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.931803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce1555-793c-405c-b68b-2e38c117714d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:28.932137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce1555-793c-405c-b68b-2e38c117714d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:28.933580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce1555-793c-405c-b68b-2e38c117714d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:28.947878 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 77/150] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:28.949597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde722-1e2b-48a8-aa64-3e48025fc8f7 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:28.949894 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde722-1e2b-48a8-aa64-3e48025fc8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:28.950177 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde722-1e2b-48a8-aa64-3e48025fc8f7 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:28.951572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 78/151] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:28.956923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde722-1e2b-48a8-aa64-3e48025fc8f7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:29.004819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:29.054769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 74/152] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:29.056725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7767c3-0b23-451f-b275-93e29c686d15 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:29.057334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7767c3-0b23-451f-b275-93e29c686d15 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:29.057803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7767c3-0b23-451f-b275-93e29c686d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:29.080264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dd7767c3-0b23-451f-b275-93e29c686d15 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:29.081830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dd7767c3-0b23-451f-b275-93e29c686d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:29.103559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde722-1e2b-48a8-aa64-3e48025fc8f7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:29.154721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 75/153] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:29.155931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7767c3-0b23-451f-b275-93e29c686d15 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:29.157380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3dcea-8cda-4f78-8701-0360ca932e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:29.158312 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3dcea-8cda-4f78-8701-0360ca932e59 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:29.158596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3dcea-8cda-4f78-8701-0360ca932e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:29.158875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3dcea-8cda-4f78-8701-0360ca932e59 None admin] PATH_INFO: `/v3/users/35a1bb04fdb644fe910032efa086d057` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:29.165665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3dcea-8cda-4f78-8701-0360ca932e59 None admin] RBAC: Authorizing `identity:get_user(user_id=35a1bb04fdb644fe910032efa086d057)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:29.167061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3dcea-8cda-4f78-8701-0360ca932e59 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:29.168769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 79/154] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:28 2022] GET /identity/v3/users/35a1bb04fdb644fe910032efa086d057 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:29.174410 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3dcea-8cda-4f78-8701-0360ca932e59 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:29.217243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:29.265223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7767c3-0b23-451f-b275-93e29c686d15 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:29.312175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3dcea-8cda-4f78-8701-0360ca932e59 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:29.314383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0e0f-fe94-47ac-abd9-604ac8434535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:29.315234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:29.315753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0e0f-fe94-47ac-abd9-604ac8434535 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:29.316228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0e0f-fe94-47ac-abd9-604ac8434535 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:29.316734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c0e0f-fe94-47ac-abd9-604ac8434535 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:29.318201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c0e0f-fe94-47ac-abd9-604ac8434535 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:29.319872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c0e0f-fe94-47ac-abd9-604ac8434535 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:29.321839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 76/155] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:29 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:29.322957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0e0f-fe94-47ac-abd9-604ac8434535 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:29.373540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90033f99-42b7-4757-af0e-e7d89b5cd688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:29.374213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90033f99-42b7-4757-af0e-e7d89b5cd688 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:29.374517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90033f99-42b7-4757-af0e-e7d89b5cd688 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:29.374970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90033f99-42b7-4757-af0e-e7d89b5cd688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:29.428865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c0e0f-fe94-47ac-abd9-604ac8434535 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:29.457215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:29.480588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d2561-ed7d-4f24-b6eb-357e1d4403e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:29.481494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2561-ed7d-4f24-b6eb-357e1d4403e2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:29.481778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2561-ed7d-4f24-b6eb-357e1d4403e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:29.482097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2561-ed7d-4f24-b6eb-357e1d4403e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:29.488209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90033f99-42b7-4757-af0e-e7d89b5cd688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:29.497941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90033f99-42b7-4757-af0e-e7d89b5cd688 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:29.501384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d2561-ed7d-4f24-b6eb-357e1d4403e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7e6d2561-ed7d-4f24-b6eb-357e1d4403e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:29.514081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:29.515225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:29.516109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 77/156] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:29.517428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d2561-ed7d-4f24-b6eb-357e1d4403e2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:29.662400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 80/157] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:22:29.663085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90033f99-42b7-4757-af0e-e7d89b5cd688 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:29.669855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d2561-ed7d-4f24-b6eb-357e1d4403e2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:29.671951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:29.748338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:29.749042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:29.749325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:29.749602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:29.750455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] RBAC: Adding query filter params (role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=ad8175c8bdea405c88557743edcacad4, user.id=412029d6037c41d8ab5af5921aa4da34) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:29.750769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:29.752848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:29.765964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 78/158] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:29 2022] GET /identity/v3/role_assignments?user.id=412029d6037c41d8ab5af5921aa4da34&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:29.766841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:29.838505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:29.855127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90033f99-42b7-4757-af0e-e7d89b5cd688 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:29.895569 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c9151-1fd0-465e-928c-afb27526caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:29.896259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9151-1fd0-465e-928c-afb27526caca None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:29.896543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9151-1fd0-465e-928c-afb27526caca None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:29.896818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9151-1fd0-465e-928c-afb27526caca None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:29.897612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c9151-1fd0-465e-928c-afb27526caca None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:29.897917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c9151-1fd0-465e-928c-afb27526caca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:29.899329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c9151-1fd0-465e-928c-afb27526caca None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:29.914793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 81/159] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:29.915933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073778-4fc0-4d5f-a011-3d65d82bcfea None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:29.916225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073778-4fc0-4d5f-a011-3d65d82bcfea None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:29.916508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073778-4fc0-4d5f-a011-3d65d82bcfea None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:29.917940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 82/160] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:29.929723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56073778-4fc0-4d5f-a011-3d65d82bcfea None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:30.000398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a11e0-9bf6-4001-89b1-c3918d42b672 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:30.062550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83ff6-1b7f-4323-9546-a57ed150d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:30.063426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ff6-1b7f-4323-9546-a57ed150d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:30.063716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ff6-1b7f-4323-9546-a57ed150d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:30.064028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ff6-1b7f-4323-9546-a57ed150d7e4 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:30.064786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:30.067345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83ff6-1b7f-4323-9546-a57ed150d7e4 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:30.069158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83ff6-1b7f-4323-9546-a57ed150d7e4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:30.071014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 79/161] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:29 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:30.072450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846e0cb-b48e-4a01-b9cc-17842d53d030 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:30.072741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846e0cb-b48e-4a01-b9cc-17842d53d030 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:30.078453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846e0cb-b48e-4a01-b9cc-17842d53d030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:30.100908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7846e0cb-b48e-4a01-b9cc-17842d53d030 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:30.102397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7846e0cb-b48e-4a01-b9cc-17842d53d030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:30.120862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56073778-4fc0-4d5f-a011-3d65d82bcfea None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:30.197417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6973f2-0138-46d2-bdb5-8cccddc2794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:30.198224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6973f2-0138-46d2-bdb5-8cccddc2794c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:30.198503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6973f2-0138-46d2-bdb5-8cccddc2794c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:30.198782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6973f2-0138-46d2-bdb5-8cccddc2794c None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:30.200958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6973f2-0138-46d2-bdb5-8cccddc2794c None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:30.202727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6973f2-0138-46d2-bdb5-8cccddc2794c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:30.205285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 83/162] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:29 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:30.205932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6973f2-0138-46d2-bdb5-8cccddc2794c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:30.238284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 80/163] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:30.239881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3afb0-58bc-4094-9d21-1e0f31167896 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:30.240314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3afb0-58bc-4094-9d21-1e0f31167896 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:30.240734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3afb0-58bc-4094-9d21-1e0f31167896 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:30.242255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 81/164] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:30.243078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3afb0-58bc-4094-9d21-1e0f31167896 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:30.303252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:30.373642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6973f2-0138-46d2-bdb5-8cccddc2794c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:30.438210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7749-c7b8-4210-924c-9a6ac86c3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:30.439147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7749-c7b8-4210-924c-9a6ac86c3f34 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:30.440442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7749-c7b8-4210-924c-9a6ac86c3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:30.440910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7749-c7b8-4210-924c-9a6ac86c3f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:30.441621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3afb0-58bc-4094-9d21-1e0f31167896 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:30.442631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d7749-c7b8-4210-924c-9a6ac86c3f34 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=ad8175c8bdea405c88557743edcacad4, user.id=35a1bb04fdb644fe910032efa086d057) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:30.444484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d7749-c7b8-4210-924c-9a6ac86c3f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:30.446121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d7749-c7b8-4210-924c-9a6ac86c3f34 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:30.449010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:30.461842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 84/165] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:30 2022] GET /identity/v3/role_assignments?user.id=35a1bb04fdb644fe910032efa086d057&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:30.463543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37886433-a319-4785-a8e0-dd42073921e6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:30.464984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37886433-a319-4785-a8e0-dd42073921e6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:30.465592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37886433-a319-4785-a8e0-dd42073921e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:30.495762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-37886433-a319-4785-a8e0-dd42073921e6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:30.497966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-37886433-a319-4785-a8e0-dd42073921e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:30.515589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c759c-b867-4f19-8210-72e53e510415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:30.516263 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c759c-b867-4f19-8210-72e53e510415 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:30.516547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c759c-b867-4f19-8210-72e53e510415 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:30.516840 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c759c-b867-4f19-8210-72e53e510415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:30.605903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 85/166] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:30.606809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37886433-a319-4785-a8e0-dd42073921e6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:30.637797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c759c-b867-4f19-8210-72e53e510415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:30.639427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c759c-b867-4f19-8210-72e53e510415 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:30.693212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:30.776210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37886433-a319-4785-a8e0-dd42073921e6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:30.818396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:30.834814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013c14-b39a-49be-bb91-66104fc330e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:30.835627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013c14-b39a-49be-bb91-66104fc330e1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:30.835908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013c14-b39a-49be-bb91-66104fc330e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:30.836186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013c14-b39a-49be-bb91-66104fc330e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:30.853919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49013c14-b39a-49be-bb91-66104fc330e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-49013c14-b39a-49be-bb91-66104fc330e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:30.861694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:30.863132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 86/167] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:30.863930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013c14-b39a-49be-bb91-66104fc330e1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:30.867467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 82/168] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:30.873858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c759c-b867-4f19-8210-72e53e510415 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:31.061656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013c14-b39a-49be-bb91-66104fc330e1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:31.072948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c759c-b867-4f19-8210-72e53e510415 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:31.110360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27ac5-31e2-4788-bf51-7994ae829e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:31.111713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27ac5-31e2-4788-bf51-7994ae829e6b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.111997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27ac5-31e2-4788-bf51-7994ae829e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.112271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27ac5-31e2-4788-bf51-7994ae829e6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.125895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:31.142288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27ac5-31e2-4788-bf51-7994ae829e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3aa27ac5-31e2-4788-bf51-7994ae829e6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:31.150584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:31.159415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 87/169] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:31.161396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27ac5-31e2-4788-bf51-7994ae829e6b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:31.163207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:31.163207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.163207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.163207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.169015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:31.169015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:31.170122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:31.184028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 83/170] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:31.185181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:31.223905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:31.286069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27ac5-31e2-4788-bf51-7994ae829e6b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:31.333973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e82e0f-066e-4c34-90fa-51317ac313b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:31.334758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82e0f-066e-4c34-90fa-51317ac313b4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.335045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82e0f-066e-4c34-90fa-51317ac313b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.335328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82e0f-066e-4c34-90fa-51317ac313b4 None admin] PATH_INFO: `/v3/projects/56fd939c35bb4a888de5cbbbb6fd26cd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.337474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e82e0f-066e-4c34-90fa-51317ac313b4 None admin] RBAC: Authorizing `identity:get_project(project_id=56fd939c35bb4a888de5cbbbb6fd26cd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:31.338945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e82e0f-066e-4c34-90fa-51317ac313b4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:31.340854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 88/171] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:31 2022] GET /identity/v3/projects/56fd939c35bb4a888de5cbbbb6fd26cd => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:31.341459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e82e0f-066e-4c34-90fa-51317ac313b4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:31.434928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd0426-ae07-4cd0-b244-caf2f94d81eb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:31.462598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e82e0f-066e-4c34-90fa-51317ac313b4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:31.481687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:31.501756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a005a-2111-4043-be45-cce367ffd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:31.502641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a005a-2111-4043-be45-cce367ffd865 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.502928 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a005a-2111-4043-be45-cce367ffd865 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.503209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a005a-2111-4043-be45-cce367ffd865 None admin] PATH_INFO: `/v3/users/412029d6037c41d8ab5af5921aa4da34` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.504435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a005a-2111-4043-be45-cce367ffd865 None admin] RBAC: Authorizing `identity:get_user(user_id=412029d6037c41d8ab5af5921aa4da34)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:31.505918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a005a-2111-4043-be45-cce367ffd865 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:31.507564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 89/172] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:31 2022] GET /identity/v3/users/412029d6037c41d8ab5af5921aa4da34 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:31.508338 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a005a-2111-4043-be45-cce367ffd865 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:31.516476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:31.517225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.517513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.517798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.518561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:31.518871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:31.520262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:31.538208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 84/173] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:31.539146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:31.622957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:31.658355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a005a-2111-4043-be45-cce367ffd865 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:31.710880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae90b6-92ef-4afe-82b4-c63aa5fb6152 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:31.735000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:31.735965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.736253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.736534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.738108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] RBAC: Adding query filter params (role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=56fd939c35bb4a888de5cbbbb6fd26cd, user.id=412029d6037c41d8ab5af5921aa4da34) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:31.738435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:31.740428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:31.748457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 90/174] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:31 2022] GET /identity/v3/role_assignments?user.id=412029d6037c41d8ab5af5921aa4da34&scope.project.id=56fd939c35bb4a888de5cbbbb6fd26cd&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:31.749318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:31.753786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181a79d-2e56-46f2-870f-d24c79aee17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:31.754569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a79d-2e56-46f2-870f-d24c79aee17f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.754956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a79d-2e56-46f2-870f-d24c79aee17f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.755335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a79d-2e56-46f2-870f-d24c79aee17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.806693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:31.866352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83caf6-0ec1-48dc-b23f-399860cba0b9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:31.910077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181a79d-2e56-46f2-870f-d24c79aee17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:31.911971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181a79d-2e56-46f2-870f-d24c79aee17f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:31.913885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a7e06-2dea-44ef-90c3-09a0365b650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:31.914857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7e06-2dea-44ef-90c3-09a0365b650e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.915221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7e06-2dea-44ef-90c3-09a0365b650e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.915578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7e06-2dea-44ef-90c3-09a0365b650e None admin] PATH_INFO: `/v3/users/2d6f596093464e32ad891ffeba14fe6d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.916973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a7e06-2dea-44ef-90c3-09a0365b650e None admin] RBAC: Authorizing `identity:get_user(user_id=2d6f596093464e32ad891ffeba14fe6d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:31.918546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a7e06-2dea-44ef-90c3-09a0365b650e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:31.920354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 91/175] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:31 2022] GET /identity/v3/users/2d6f596093464e32ad891ffeba14fe6d => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:31.921803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652b2a7-3d20-4215-a3bb-55f94f3b2f5f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.922160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652b2a7-3d20-4215-a3bb-55f94f3b2f5f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.922512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652b2a7-3d20-4215-a3bb-55f94f3b2f5f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.927190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 92/176] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:31.927190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394044e-b183-4734-98c0-00584936f89d None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:31.927190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394044e-b183-4734-98c0-00584936f89d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:31.927190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394044e-b183-4734-98c0-00584936f89d None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:31.931282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 93/177] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:31.932516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394044e-b183-4734-98c0-00584936f89d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:31.989208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:32.059910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 85/178] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:32.063096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551cb6-bc11-4bd4-a2f8-872b62e16ab5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.063096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551cb6-bc11-4bd4-a2f8-872b62e16ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.063096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0551cb6-bc11-4bd4-a2f8-872b62e16ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.072449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394044e-b183-4734-98c0-00584936f89d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:32.086779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f0551cb6-bc11-4bd4-a2f8-872b62e16ab5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:32.088553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f0551cb6-bc11-4bd4-a2f8-872b62e16ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:32.092423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:32.112755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d6b39-b862-4599-8ae6-44de1834909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:32.113652 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6b39-b862-4599-8ae6-44de1834909e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.113939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6b39-b862-4599-8ae6-44de1834909e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.114217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6b39-b862-4599-8ae6-44de1834909e None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.115528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d6b39-b862-4599-8ae6-44de1834909e None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:32.116867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d6b39-b862-4599-8ae6-44de1834909e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:32.118923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 94/179] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:31 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:32.119865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2af0df-a6da-4ff6-8616-5baed5b21ffa None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.120154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2af0df-a6da-4ff6-8616-5baed5b21ffa None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.120434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2af0df-a6da-4ff6-8616-5baed5b21ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.138165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6d2af0df-a6da-4ff6-8616-5baed5b21ffa None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:32.139668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6d2af0df-a6da-4ff6-8616-5baed5b21ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:32.165412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 86/180] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:32.166099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0551cb6-bc11-4bd4-a2f8-872b62e16ab5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.223184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 95/181] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:32.224365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2af0df-a6da-4ff6-8616-5baed5b21ffa None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.253855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:32.275624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0551cb6-bc11-4bd4-a2f8-872b62e16ab5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:32.311741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226f52-c1dd-44c1-bce3-bef64ab20be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:32.312597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226f52-c1dd-44c1-bce3-bef64ab20be8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.312905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226f52-c1dd-44c1-bce3-bef64ab20be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.313195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226f52-c1dd-44c1-bce3-bef64ab20be8 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.314885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96226f52-c1dd-44c1-bce3-bef64ab20be8 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:32.316335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96226f52-c1dd-44c1-bce3-bef64ab20be8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:32.318070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 87/182] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:32 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:32.318837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226f52-c1dd-44c1-bce3-bef64ab20be8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.323820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2af0df-a6da-4ff6-8616-5baed5b21ffa None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:32.338351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:32.357907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123cab-5575-42e1-a3ce-f73f4c42b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:32.358793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123cab-5575-42e1-a3ce-f73f4c42b8f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.359096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123cab-5575-42e1-a3ce-f73f4c42b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.359382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123cab-5575-42e1-a3ce-f73f4c42b8f3 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4/users/2d6f596093464e32ad891ffeba14fe6d/roles/42ddc037011a4faf942409f6f034415c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.361436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83123cab-5575-42e1-a3ce-f73f4c42b8f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad8175c8bdea405c88557743edcacad4, user_id=2d6f596093464e32ad891ffeba14fe6d, role_id=42ddc037011a4faf942409f6f034415c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:32.362896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83123cab-5575-42e1-a3ce-f73f4c42b8f3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:32.375829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 96/183] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:32 2022] PUT /identity/v3/projects/ad8175c8bdea405c88557743edcacad4/users/2d6f596093464e32ad891ffeba14fe6d/roles/42ddc037011a4faf942409f6f034415c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:32.389030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123cab-5575-42e1-a3ce-f73f4c42b8f3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.440337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226f52-c1dd-44c1-bce3-bef64ab20be8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:32.477184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e85f6-87be-4d29-97ae-aac9e6d1aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:32.477998 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e85f6-87be-4d29-97ae-aac9e6d1aab4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.478282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e85f6-87be-4d29-97ae-aac9e6d1aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.478559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e85f6-87be-4d29-97ae-aac9e6d1aab4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.479851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e85f6-87be-4d29-97ae-aac9e6d1aab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:32.481373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e85f6-87be-4d29-97ae-aac9e6d1aab4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:32.483260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 88/184] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:32.484424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376284-9946-4ea7-a6d6-021b1f430a43 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.484713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376284-9946-4ea7-a6d6-021b1f430a43 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.485018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5376284-9946-4ea7-a6d6-021b1f430a43 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.489051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 89/185] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:32.489051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5376284-9946-4ea7-a6d6-021b1f430a43 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.496709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123cab-5575-42e1-a3ce-f73f4c42b8f3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:32.506256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:32.534320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c617f-9700-40e2-8a90-551f52f7ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:32.535144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c617f-9700-40e2-8a90-551f52f7ccf0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.535426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c617f-9700-40e2-8a90-551f52f7ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.535703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c617f-9700-40e2-8a90-551f52f7ccf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.547285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c617f-9700-40e2-8a90-551f52f7ccf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-865c617f-9700-40e2-8a90-551f52f7ccf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:32.556485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:32.557470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:32.558305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 97/186] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:32.559006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c617f-9700-40e2-8a90-551f52f7ccf0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.598669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:32.609355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5376284-9946-4ea7-a6d6-021b1f430a43 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:32.647412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e96c1-f004-4bce-8501-5bb3445e0bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:32.648069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e96c1-f004-4bce-8501-5bb3445e0bac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.648402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e96c1-f004-4bce-8501-5bb3445e0bac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.648686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e96c1-f004-4bce-8501-5bb3445e0bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.649806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e96c1-f004-4bce-8501-5bb3445e0bac None admin] RBAC: Adding query filter params (role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=ad8175c8bdea405c88557743edcacad4, user.id=412029d6037c41d8ab5af5921aa4da34) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:32.650123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e96c1-f004-4bce-8501-5bb3445e0bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:32.651564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e96c1-f004-4bce-8501-5bb3445e0bac None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:32.664926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 90/187] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:32 2022] GET /identity/v3/role_assignments?user.id=412029d6037c41d8ab5af5921aa4da34&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:32.664926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df45c5d-10c1-49d6-8c34-4d5504e048de None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.664926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df45c5d-10c1-49d6-8c34-4d5504e048de None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.664926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df45c5d-10c1-49d6-8c34-4d5504e048de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.677733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c617f-9700-40e2-8a90-551f52f7ccf0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:32.679014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2df45c5d-10c1-49d6-8c34-4d5504e048de None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:32.680448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2df45c5d-10c1-49d6-8c34-4d5504e048de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:32.725903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e744a-170a-409c-ad05-1d99589b9cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:32.726613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e744a-170a-409c-ad05-1d99589b9cdf None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.726965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e744a-170a-409c-ad05-1d99589b9cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.727312 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e744a-170a-409c-ad05-1d99589b9cdf None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.728105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e744a-170a-409c-ad05-1d99589b9cdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:32.730450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e744a-170a-409c-ad05-1d99589b9cdf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:32.762132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 98/188] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:22:32 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:32.762994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e744a-170a-409c-ad05-1d99589b9cdf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.773614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 91/189] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:32.810869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df45c5d-10c1-49d6-8c34-4d5504e048de None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.830062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:32.878617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:32.895414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e744a-170a-409c-ad05-1d99589b9cdf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:32.936785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:32.937821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:32.938358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:32.939349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:32.940332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:32.940881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:32.942656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:32.952638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 99/190] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:32.959446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:32.960255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df45c5d-10c1-49d6-8c34-4d5504e048de None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:33.000628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bebcdb-61b7-40e1-9ba7-3001364cbdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:33.002680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebcdb-61b7-40e1-9ba7-3001364cbdaa None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:33.002680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebcdb-61b7-40e1-9ba7-3001364cbdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:33.002680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebcdb-61b7-40e1-9ba7-3001364cbdaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:33.015099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bebcdb-61b7-40e1-9ba7-3001364cbdaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c1bebcdb-61b7-40e1-9ba7-3001364cbdaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:33.025613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:33.026549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:33.027772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 92/191] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:22:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:33.032567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bebcdb-61b7-40e1-9ba7-3001364cbdaa None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:33.084177 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9294-d851-44e5-8fd9-12f229b37757 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:33.122404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:33.133386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54768490-9544-44c6-8b32-5085363d1251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:33.134275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54768490-9544-44c6-8b32-5085363d1251 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:33.134919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54768490-9544-44c6-8b32-5085363d1251 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:33.135204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54768490-9544-44c6-8b32-5085363d1251 None admin] PATH_INFO: `/v3/users/b96c10d41ec24631accd317326c7bc24` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:33.150825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54768490-9544-44c6-8b32-5085363d1251 None admin] RBAC: Authorizing `identity:get_user(user_id=b96c10d41ec24631accd317326c7bc24)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:33.152169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54768490-9544-44c6-8b32-5085363d1251 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:33.154258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 100/192] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:32 2022] GET /identity/v3/users/b96c10d41ec24631accd317326c7bc24 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:33.159627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54768490-9544-44c6-8b32-5085363d1251 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:33.160386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bebcdb-61b7-40e1-9ba7-3001364cbdaa None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:33.179737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:33.204493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:33.205334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:33.205622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:33.205905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:33.206665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:33.206975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:33.209461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:33.218669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 93/193] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:22:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:33.224704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:33.298776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54768490-9544-44c6-8b32-5085363d1251 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:33.348852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b3bea-184e-4ffc-9898-dac195c9ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:33.349538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b3bea-184e-4ffc-9898-dac195c9ba9e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:33.349876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b3bea-184e-4ffc-9898-dac195c9ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:33.350162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b3bea-184e-4ffc-9898-dac195c9ba9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:33.350590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0022b-d59d-4e74-b416-bb2385fb7530 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:33.383315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:33.390585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae41c8-4992-4996-a1db-f0a3f7b9e7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:33.391725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae41c8-4992-4996-a1db-f0a3f7b9e7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:33.392799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae41c8-4992-4996-a1db-f0a3f7b9e7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:33.393310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae41c8-4992-4996-a1db-f0a3f7b9e7b4 None admin] PATH_INFO: `/v3/users/b96c10d41ec24631accd317326c7bc24` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:33.395266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae41c8-4992-4996-a1db-f0a3f7b9e7b4 None admin] RBAC: Authorizing `identity:get_user(user_id=b96c10d41ec24631accd317326c7bc24)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:33.397035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae41c8-4992-4996-a1db-f0a3f7b9e7b4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:33.398972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 94/194] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:33 2022] GET /identity/v3/users/b96c10d41ec24631accd317326c7bc24 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:33.407162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae41c8-4992-4996-a1db-f0a3f7b9e7b4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:33.444057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b3bea-184e-4ffc-9898-dac195c9ba9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:33.446093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b3bea-184e-4ffc-9898-dac195c9ba9e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:33.458847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:33.534014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae41c8-4992-4996-a1db-f0a3f7b9e7b4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:33.572437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672713-b923-4808-a3b9-5c1c71540fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:33.573257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672713-b923-4808-a3b9-5c1c71540fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:33.573550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672713-b923-4808-a3b9-5c1c71540fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:33.573830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672713-b923-4808-a3b9-5c1c71540fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:33.634147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 101/195] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:22:33.639763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b3bea-184e-4ffc-9898-dac195c9ba9e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:33.648896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:33.659931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e672713-b923-4808-a3b9-5c1c71540fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:33.661445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e672713-b923-4808-a3b9-5c1c71540fe1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:33.776156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b3bea-184e-4ffc-9898-dac195c9ba9e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:33.792315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:33.818844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e43cb1-998b-4aa4-acad-7aa3e0f0edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:33.820032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e43cb1-998b-4aa4-acad-7aa3e0f0edae None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:33.820508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e43cb1-998b-4aa4-acad-7aa3e0f0edae None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:33.821017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e43cb1-998b-4aa4-acad-7aa3e0f0edae None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:33.822726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e43cb1-998b-4aa4-acad-7aa3e0f0edae None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:33.824815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e43cb1-998b-4aa4-acad-7aa3e0f0edae None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:33.827370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 102/196] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:33 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:33.833138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e43cb1-998b-4aa4-acad-7aa3e0f0edae None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:33.854566 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 95/197] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:22:33.859974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672713-b923-4808-a3b9-5c1c71540fe1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:34.030289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:34.036610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672713-b923-4808-a3b9-5c1c71540fe1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:34.073454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e43cb1-998b-4aa4-acad-7aa3e0f0edae None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:34.075949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e48e57-a7a2-4e6f-8be7-4181eda44d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:34.077115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e48e57-a7a2-4e6f-8be7-4181eda44d3d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:34.077630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e48e57-a7a2-4e6f-8be7-4181eda44d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:34.078096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e48e57-a7a2-4e6f-8be7-4181eda44d3d None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:34.086492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e48e57-a7a2-4e6f-8be7-4181eda44d3d None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:34.088462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e48e57-a7a2-4e6f-8be7-4181eda44d3d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:34.091598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 96/198] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:33 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:34.098251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e48e57-a7a2-4e6f-8be7-4181eda44d3d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:34.253142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e48e57-a7a2-4e6f-8be7-4181eda44d3d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:34.269557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058762b-13d4-499d-8f64-86ccf8d313b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:34.270250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058762b-13d4-499d-8f64-86ccf8d313b2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:34.270543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058762b-13d4-499d-8f64-86ccf8d313b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:34.270828 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058762b-13d4-499d-8f64-86ccf8d313b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:34.271680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058762b-13d4-499d-8f64-86ccf8d313b2 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=66a61523318545c98b246fc2d64ad948, user.id=b96c10d41ec24631accd317326c7bc24) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:34.272000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058762b-13d4-499d-8f64-86ccf8d313b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:34.277612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058762b-13d4-499d-8f64-86ccf8d313b2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:34.296167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cb2ce-2eea-4adf-b206-eb08b4f786ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:34.297354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb2ce-2eea-4adf-b206-eb08b4f786ce None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:34.297836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb2ce-2eea-4adf-b206-eb08b4f786ce None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:34.298401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb2ce-2eea-4adf-b206-eb08b4f786ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:34.299320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 103/199] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:33 2022] GET /identity/v3/role_assignments?user.id=b96c10d41ec24631accd317326c7bc24&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 259 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:34.299697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb2ce-2eea-4adf-b206-eb08b4f786ce None admin] RBAC: Adding query filter params (role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=66a61523318545c98b246fc2d64ad948, user.id=b96c10d41ec24631accd317326c7bc24) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:34.300331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb2ce-2eea-4adf-b206-eb08b4f786ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:34.302120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb2ce-2eea-4adf-b206-eb08b4f786ce None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:34.309974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 97/200] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:34 2022] GET /identity/v3/role_assignments?user.id=b96c10d41ec24631accd317326c7bc24&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:34.962211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb8201-42f6-4f6c-887f-17586ae379f7 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:34.962610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb8201-42f6-4f6c-887f-17586ae379f7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:34.962786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb8201-42f6-4f6c-887f-17586ae379f7 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:34.964289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 104/201] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:34.970601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12260cc5-0152-4775-ac27-92dfe2c8209a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:34.970601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12260cc5-0152-4775-ac27-92dfe2c8209a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:34.970601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12260cc5-0152-4775-ac27-92dfe2c8209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:34.997135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-12260cc5-0152-4775-ac27-92dfe2c8209a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:34.998647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-12260cc5-0152-4775-ac27-92dfe2c8209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:35.024412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:35.090904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 98/202] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:35.126391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb8201-42f6-4f6c-887f-17586ae379f7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:35.192357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:35.262504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb8201-42f6-4f6c-887f-17586ae379f7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:35.311874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa859df-2922-4c3d-9866-27e9f25f4174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:35.312680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa859df-2922-4c3d-9866-27e9f25f4174 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:35.312993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa859df-2922-4c3d-9866-27e9f25f4174 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:35.313276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa859df-2922-4c3d-9866-27e9f25f4174 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:35.329766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa859df-2922-4c3d-9866-27e9f25f4174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0aa859df-2922-4c3d-9866-27e9f25f4174 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:35.337790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:35.338678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:35.339474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 105/203] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:35.348665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12260cc5-0152-4775-ac27-92dfe2c8209a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:35.537609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12260cc5-0152-4775-ac27-92dfe2c8209a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:35.581098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c60182-c68e-4686-b385-a13d4badb69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:35.582177 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c60182-c68e-4686-b385-a13d4badb69f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:35.582761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c60182-c68e-4686-b385-a13d4badb69f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:35.583236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c60182-c68e-4686-b385-a13d4badb69f None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:35.584212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c60182-c68e-4686-b385-a13d4badb69f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:35.584725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c60182-c68e-4686-b385-a13d4badb69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:35.586387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c60182-c68e-4686-b385-a13d4badb69f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:35.604851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 99/204] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:35.609933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa859df-2922-4c3d-9866-27e9f25f4174 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:35.759396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de690-54a1-4e00-9e45-96992545bc3e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:35.759764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de690-54a1-4e00-9e45-96992545bc3e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:35.759944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de690-54a1-4e00-9e45-96992545bc3e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:35.761482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 100/205] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:35.771194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b515-9074-4836-804e-3adbd17a853d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:35.771480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b515-9074-4836-804e-3adbd17a853d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:35.771764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b515-9074-4836-804e-3adbd17a853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:35.794037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa859df-2922-4c3d-9866-27e9f25f4174 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:35.797131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:35.810509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ce13b515-9074-4836-804e-3adbd17a853d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:35.811720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ce13b515-9074-4836-804e-3adbd17a853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:35.845711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:35.860405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317231a-ea48-419f-93ce-266bd70d2528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:35.861934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317231a-ea48-419f-93ce-266bd70d2528 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:35.862220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317231a-ea48-419f-93ce-266bd70d2528 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:35.862501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317231a-ea48-419f-93ce-266bd70d2528 None admin] PATH_INFO: `/v3/users/2d6f596093464e32ad891ffeba14fe6d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:35.863980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317231a-ea48-419f-93ce-266bd70d2528 None admin] RBAC: Authorizing `identity:get_user(user_id=2d6f596093464e32ad891ffeba14fe6d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:35.865523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317231a-ea48-419f-93ce-266bd70d2528 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:35.867259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 106/206] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:35 2022] GET /identity/v3/users/2d6f596093464e32ad891ffeba14fe6d => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:35.877888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317231a-ea48-419f-93ce-266bd70d2528 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:35.941580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 101/207] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:36.004300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13b515-9074-4836-804e-3adbd17a853d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:36.024337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317231a-ea48-419f-93ce-266bd70d2528 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:36.061459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e300088-e7f7-4550-93f8-7ba911cc6ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:36.062277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300088-e7f7-4550-93f8-7ba911cc6ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.062569 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300088-e7f7-4550-93f8-7ba911cc6ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.062852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300088-e7f7-4550-93f8-7ba911cc6ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.108363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:36.146086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e300088-e7f7-4550-93f8-7ba911cc6ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:36.147853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e300088-e7f7-4550-93f8-7ba911cc6ee7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:36.193703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13b515-9074-4836-804e-3adbd17a853d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:36.243008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706eb1d-6d1f-4cc1-baad-a8fd591fc439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:36.243808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eb1d-6d1f-4cc1-baad-a8fd591fc439 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.244093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eb1d-6d1f-4cc1-baad-a8fd591fc439 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.244368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eb1d-6d1f-4cc1-baad-a8fd591fc439 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.254858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706eb1d-6d1f-4cc1-baad-a8fd591fc439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7706eb1d-6d1f-4cc1-baad-a8fd591fc439 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:36.262694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:36.263564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:36.264375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 102/208] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:36.265593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48de12-1ee2-4158-bc6d-7e5cff75cfa5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.268866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48de12-1ee2-4158-bc6d-7e5cff75cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.268866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48de12-1ee2-4158-bc6d-7e5cff75cfa5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.268866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 103/209] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:36.270984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48de12-1ee2-4158-bc6d-7e5cff75cfa5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:36.277446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 107/210] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:36.279076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9868fd-ebf1-48f7-ab43-1ac24ddac072 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.279463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9868fd-ebf1-48f7-ab43-1ac24ddac072 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.279842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9868fd-ebf1-48f7-ab43-1ac24ddac072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.290028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:36.299263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-af9868fd-ebf1-48f7-ab43-1ac24ddac072 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:36.300623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-af9868fd-ebf1-48f7-ab43-1ac24ddac072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:36.374897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:36.381698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 108/211] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:36.382871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9868fd-ebf1-48f7-ab43-1ac24ddac072 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:36.406850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48de12-1ee2-4158-bc6d-7e5cff75cfa5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:36.457470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:36.458153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.458444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.458729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.459745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:36.460065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:36.462640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:36.476912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 104/212] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:36.478128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:36.497632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9868fd-ebf1-48f7-ab43-1ac24ddac072 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:36.534778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1840c1-6ca6-435c-ab74-9002884d87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:36.535651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1840c1-6ca6-435c-ab74-9002884d87fb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.535936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1840c1-6ca6-435c-ab74-9002884d87fb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.536213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1840c1-6ca6-435c-ab74-9002884d87fb None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.537953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1840c1-6ca6-435c-ab74-9002884d87fb None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:36.538909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1840c1-6ca6-435c-ab74-9002884d87fb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:36.540931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 109/213] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:36 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:36.544914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1840c1-6ca6-435c-ab74-9002884d87fb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:36.578954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:36.605907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229a2db-a6d5-4403-861f-f696fceef748 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:36.625567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:36.644086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca2e81-3123-4606-9e0c-a2bfec6ae5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:36.645271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca2e81-3123-4606-9e0c-a2bfec6ae5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.645559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca2e81-3123-4606-9e0c-a2bfec6ae5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.645839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca2e81-3123-4606-9e0c-a2bfec6ae5a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.647018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca2e81-3123-4606-9e0c-a2bfec6ae5a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:36.648585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca2e81-3123-4606-9e0c-a2bfec6ae5a8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:36.650530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 105/214] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:36.651122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca2e81-3123-4606-9e0c-a2bfec6ae5a8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:36.671104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1840c1-6ca6-435c-ab74-9002884d87fb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:36.707585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db9f5-2549-41e1-8eaf-1ff9a57bbf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:36.708553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db9f5-2549-41e1-8eaf-1ff9a57bbf6c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.708904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db9f5-2549-41e1-8eaf-1ff9a57bbf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.709186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db9f5-2549-41e1-8eaf-1ff9a57bbf6c None admin] PATH_INFO: `/v3/users/106f47070cf6447c9d54816ba4a1aecd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.724407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3db9f5-2549-41e1-8eaf-1ff9a57bbf6c None admin] RBAC: Authorizing `identity:get_user(user_id=106f47070cf6447c9d54816ba4a1aecd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:36.725898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3db9f5-2549-41e1-8eaf-1ff9a57bbf6c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:36.727875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 110/215] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:36 2022] GET /identity/v3/users/106f47070cf6447c9d54816ba4a1aecd => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:36.728458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db9f5-2549-41e1-8eaf-1ff9a57bbf6c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:36.788597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca2e81-3123-4606-9e0c-a2bfec6ae5a8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:36.833042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:36.834066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.834582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.835708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.837380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] RBAC: Adding query filter params (role.id=42ddc037011a4faf942409f6f034415c, scope.project.id=ad8175c8bdea405c88557743edcacad4, user.id=2d6f596093464e32ad891ffeba14fe6d) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:36.837926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:36.840789 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:36.850464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db9f5-2549-41e1-8eaf-1ff9a57bbf6c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:36.857420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 106/216] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:36 2022] GET /identity/v3/role_assignments?user.id=2d6f596093464e32ad891ffeba14fe6d&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=42ddc037011a4faf942409f6f034415c => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:36.857420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:36.872793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:36.909385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:36.930261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6037f-e9dc-441f-bed7-d410318ba00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:36.930974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6037f-e9dc-441f-bed7-d410318ba00e None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:36.931257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6037f-e9dc-441f-bed7-d410318ba00e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:36.931546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6037f-e9dc-441f-bed7-d410318ba00e None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:36.932276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6037f-e9dc-441f-bed7-d410318ba00e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:36.933805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6037f-e9dc-441f-bed7-d410318ba00e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:36.982080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 111/217] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:22:36 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:37.001229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467868-89fe-4ff8-ba76-1eb67a769e28 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.001549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467868-89fe-4ff8-ba76-1eb67a769e28 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.001789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77467868-89fe-4ff8-ba76-1eb67a769e28 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.003649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 112/218] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:37.009256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e987e31-a4d2-4ec5-a249-cae960140da6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.009546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e987e31-a4d2-4ec5-a249-cae960140da6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.009803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e987e31-a4d2-4ec5-a249-cae960140da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.037536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249f10d-dee9-4836-911c-318b6bfc210b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.040326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7e987e31-a4d2-4ec5-a249-cae960140da6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:37.042507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7e987e31-a4d2-4ec5-a249-cae960140da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:37.090707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ef9c5-a7c4-4a6a-be7f-c48807a5d2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.091496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ef9c5-a7c4-4a6a-be7f-c48807a5d2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.091886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ef9c5-a7c4-4a6a-be7f-c48807a5d2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.092272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ef9c5-a7c4-4a6a-be7f-c48807a5d2d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.137061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 113/219] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:37.138906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546c585-fbf2-4a1e-9bf5-45257a1e2787 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.139280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546c585-fbf2-4a1e-9bf5-45257a1e2787 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.139463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546c585-fbf2-4a1e-9bf5-45257a1e2787 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.141038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 114/220] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:37.148062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125fb8-2136-49cf-8ae7-35fb446da94d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.148661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125fb8-2136-49cf-8ae7-35fb446da94d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.148661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125fb8-2136-49cf-8ae7-35fb446da94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.172367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-af125fb8-2136-49cf-8ae7-35fb446da94d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:37.173728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-af125fb8-2136-49cf-8ae7-35fb446da94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:37.194621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ef9c5-a7c4-4a6a-be7f-c48807a5d2d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:37.196446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ef9c5-a7c4-4a6a-be7f-c48807a5d2d5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:37.205436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:37.256555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 115/221] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:37.257531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af125fb8-2136-49cf-8ae7-35fb446da94d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.309175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:37.311125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 107/222] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:37.312416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ef9c5-a7c4-4a6a-be7f-c48807a5d2d5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.378034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af125fb8-2136-49cf-8ae7-35fb446da94d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.415324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392482f0-843b-4720-8c24-897690c2e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.416143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392482f0-843b-4720-8c24-897690c2e41b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.416424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392482f0-843b-4720-8c24-897690c2e41b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.416698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392482f0-843b-4720-8c24-897690c2e41b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.426708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ef9c5-a7c4-4a6a-be7f-c48807a5d2d5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.431472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392482f0-843b-4720-8c24-897690c2e41b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:37.436224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-392482f0-843b-4720-8c24-897690c2e41b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:37.439809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:37.440937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:37.441964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 116/223] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:37.442655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392482f0-843b-4720-8c24-897690c2e41b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.480814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de040bc5-a904-4788-997a-41ac0ba161fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.482108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040bc5-a904-4788-997a-41ac0ba161fc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.482483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040bc5-a904-4788-997a-41ac0ba161fc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.482856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040bc5-a904-4788-997a-41ac0ba161fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.494855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de040bc5-a904-4788-997a-41ac0ba161fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-de040bc5-a904-4788-997a-41ac0ba161fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:37.503335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:37.504406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:37.505273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 108/224] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:37.505945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de040bc5-a904-4788-997a-41ac0ba161fc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.569214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392482f0-843b-4720-8c24-897690c2e41b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.571269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:37.606866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820122b-1761-4f06-9e06-eabd972925f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.607730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820122b-1761-4f06-9e06-eabd972925f5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.608008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820122b-1761-4f06-9e06-eabd972925f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.608281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820122b-1761-4f06-9e06-eabd972925f5 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.609617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820122b-1761-4f06-9e06-eabd972925f5 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:37.611232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820122b-1761-4f06-9e06-eabd972925f5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:37.612963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 117/225] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:37.613306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de040bc5-a904-4788-997a-41ac0ba161fc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.613729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820122b-1761-4f06-9e06-eabd972925f5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.650036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.650756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.651037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.651363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.652119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:37.652427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:37.653846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:37.666979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 109/226] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:37.667993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.699598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:37.719926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820122b-1761-4f06-9e06-eabd972925f5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.755867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.756544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.756846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.757126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.757973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:37.758384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:37.759767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:37.768686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 118/227] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:37.769544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.777296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e11808-34c4-4d9c-9d1a-3a008c220ed1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.802075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:37.816570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.817266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.817551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.817829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.818663 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] RBAC: Adding query filter params (role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=66a61523318545c98b246fc2d64ad948, user.id=106f47070cf6447c9d54816ba4a1aecd) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:37.819072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:37.820635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:37.826807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 110/228] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/role_assignments?user.id=106f47070cf6447c9d54816ba4a1aecd&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:37.827431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.879291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504f2bd-41b5-412d-9bc7-4b31de57d9e6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.916153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2be8af-78e4-4c8d-a04a-04eb07ac58db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.917260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2be8af-78e4-4c8d-a04a-04eb07ac58db None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.917605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2be8af-78e4-4c8d-a04a-04eb07ac58db None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.917953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2be8af-78e4-4c8d-a04a-04eb07ac58db None admin] PATH_INFO: `/v3/users/b96c10d41ec24631accd317326c7bc24` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.919345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2be8af-78e4-4c8d-a04a-04eb07ac58db None admin] RBAC: Authorizing `identity:get_user(user_id=b96c10d41ec24631accd317326c7bc24)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:37.920993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2be8af-78e4-4c8d-a04a-04eb07ac58db None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:37.923547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 119/229] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/users/b96c10d41ec24631accd317326c7bc24 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:37.933724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:37.934848 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2be8af-78e4-4c8d-a04a-04eb07ac58db None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:37.943358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45bb56-979c-46c4-a8df-05d53da6bfb9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:37.983751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4a93c-32e5-4f9d-96b6-21ae7c1ea81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:37.984810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4a93c-32e5-4f9d-96b6-21ae7c1ea81f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:37.985110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4a93c-32e5-4f9d-96b6-21ae7c1ea81f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:37.985371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4a93c-32e5-4f9d-96b6-21ae7c1ea81f None admin] PATH_INFO: `/v3/users/b96c10d41ec24631accd317326c7bc24` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:37.988208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4a93c-32e5-4f9d-96b6-21ae7c1ea81f None admin] RBAC: Authorizing `identity:get_user(user_id=b96c10d41ec24631accd317326c7bc24)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:37.993550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4a93c-32e5-4f9d-96b6-21ae7c1ea81f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:37.998741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 111/230] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/users/b96c10d41ec24631accd317326c7bc24 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:38.003091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4a93c-32e5-4f9d-96b6-21ae7c1ea81f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:38.136338 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:38.139757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2be8af-78e4-4c8d-a04a-04eb07ac58db None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:38.151223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4a93c-32e5-4f9d-96b6-21ae7c1ea81f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:38.177259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76aea8-63fc-47dd-8d95-2353e23f107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:38.178227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76aea8-63fc-47dd-8d95-2353e23f107d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:38.178616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76aea8-63fc-47dd-8d95-2353e23f107d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:38.178900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76aea8-63fc-47dd-8d95-2353e23f107d None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:38.185548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76aea8-63fc-47dd-8d95-2353e23f107d None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:38.186372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703ff01-e468-4709-9e5d-03d58f8f80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:38.187004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76aea8-63fc-47dd-8d95-2353e23f107d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:38.187233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703ff01-e468-4709-9e5d-03d58f8f80df None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:38.187518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703ff01-e468-4709-9e5d-03d58f8f80df None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:38.187799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703ff01-e468-4709-9e5d-03d58f8f80df None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:38.189052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703ff01-e468-4709-9e5d-03d58f8f80df None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:38.190496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703ff01-e468-4709-9e5d-03d58f8f80df None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:38.192444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 112/232] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:38 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:38.192624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 120/232] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:37 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:38.202116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76aea8-63fc-47dd-8d95-2353e23f107d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:38.202689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703ff01-e468-4709-9e5d-03d58f8f80df None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:38.275138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:38.317982 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76aea8-63fc-47dd-8d95-2353e23f107d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:38.358912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d8e62-c88f-4373-bac1-f0e580df7b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:38.359813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d8e62-c88f-4373-bac1-f0e580df7b2d None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:38.360095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d8e62-c88f-4373-bac1-f0e580df7b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:38.360372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d8e62-c88f-4373-bac1-f0e580df7b2d None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948/users/b96c10d41ec24631accd317326c7bc24/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:38.363539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d8e62-c88f-4373-bac1-f0e580df7b2d None admin] RBAC: Authorizing `identity:create_grant(project_id=66a61523318545c98b246fc2d64ad948, user_id=b96c10d41ec24631accd317326c7bc24, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:38.366347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d8e62-c88f-4373-bac1-f0e580df7b2d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:38.394838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 121/233] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:38 2022] PUT /identity/v3/projects/66a61523318545c98b246fc2d64ad948/users/b96c10d41ec24631accd317326c7bc24/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:38.435468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703ff01-e468-4709-9e5d-03d58f8f80df None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:38.484665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906451-f225-455f-bce8-ae1dcf004fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:38.486210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906451-f225-455f-bce8-ae1dcf004fe0 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:38.486502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906451-f225-455f-bce8-ae1dcf004fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:38.486781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906451-f225-455f-bce8-ae1dcf004fe0 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948/users/b96c10d41ec24631accd317326c7bc24/roles/5a932a8a65dd4faab8c58bcf29388fc7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:38.495139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31906451-f225-455f-bce8-ae1dcf004fe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=66a61523318545c98b246fc2d64ad948, user_id=b96c10d41ec24631accd317326c7bc24, role_id=5a932a8a65dd4faab8c58bcf29388fc7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:38.496643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31906451-f225-455f-bce8-ae1dcf004fe0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:38.514725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 113/234] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:38 2022] PUT /identity/v3/projects/66a61523318545c98b246fc2d64ad948/users/b96c10d41ec24631accd317326c7bc24/roles/5a932a8a65dd4faab8c58bcf29388fc7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:39.773125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628c3a-6ce3-46d2-a04f-c21ee0ecd7bc None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:39.773613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628c3a-6ce3-46d2-a04f-c21ee0ecd7bc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:39.773613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628c3a-6ce3-46d2-a04f-c21ee0ecd7bc None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:39.775188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 122/235] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:39.780501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef833b5-720b-425e-94a3-04e27ec5b3f9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:39.780930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef833b5-720b-425e-94a3-04e27ec5b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:39.781084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef833b5-720b-425e-94a3-04e27ec5b3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:39.801846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3ef833b5-720b-425e-94a3-04e27ec5b3f9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:39.803312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3ef833b5-720b-425e-94a3-04e27ec5b3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:39.880318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722474d5-c7e7-47c1-ad33-63684a0fdc17 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:39.880633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722474d5-c7e7-47c1-ad33-63684a0fdc17 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:39.880901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722474d5-c7e7-47c1-ad33-63684a0fdc17 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:39.882269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 123/236] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:39.891015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8530e-6f1a-43be-8f97-f6d3fdb8ebd4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:39.891343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8530e-6f1a-43be-8f97-f6d3fdb8ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:39.891563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8530e-6f1a-43be-8f97-f6d3fdb8ebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:39.914512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 114/237] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:39.917861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-58e8530e-6f1a-43be-8f97-f6d3fdb8ebd4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:39.919092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-58e8530e-6f1a-43be-8f97-f6d3fdb8ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:39.937520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef833b5-720b-425e-94a3-04e27ec5b3f9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:39.960634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:39.965526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:40.047973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 124/238] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:40.077146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8530e-6f1a-43be-8f97-f6d3fdb8ebd4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:40.108914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef833b5-720b-425e-94a3-04e27ec5b3f9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:40.175061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4b83a-db4c-4869-8c75-777f59d7b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:40.175860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b83a-db4c-4869-8c75-777f59d7b59c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:40.176143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b83a-db4c-4869-8c75-777f59d7b59c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:40.176420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4b83a-db4c-4869-8c75-777f59d7b59c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:40.195887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4b83a-db4c-4869-8c75-777f59d7b59c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f0c4b83a-db4c-4869-8c75-777f59d7b59c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:40.210977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:40.212319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:40.213357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:40.216401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 115/239] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:40.222555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4b83a-db4c-4869-8c75-777f59d7b59c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:40.253411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8530e-6f1a-43be-8f97-f6d3fdb8ebd4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:40.342397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06369c-4a22-4722-8ac5-5ea1f3aff74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:40.343545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06369c-4a22-4722-8ac5-5ea1f3aff74e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:40.344031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06369c-4a22-4722-8ac5-5ea1f3aff74e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:40.344507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06369c-4a22-4722-8ac5-5ea1f3aff74e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:40.347055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06369c-4a22-4722-8ac5-5ea1f3aff74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:40.348738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06369c-4a22-4722-8ac5-5ea1f3aff74e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:40.349182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:40.350612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 125/240] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:40.356058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06369c-4a22-4722-8ac5-5ea1f3aff74e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:40.391531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4b83a-db4c-4869-8c75-777f59d7b59c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:40.409137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:40.467600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:40.468392 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:40.468684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:40.468989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:40.470391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:40.470702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:40.472094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:40.491161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 116/241] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:40.492721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06369c-4a22-4722-8ac5-5ea1f3aff74e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:40.496392 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:40.529987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3686b2-4fa7-4ca0-a88c-05dd5d3f1be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:40.530688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3686b2-4fa7-4ca0-a88c-05dd5d3f1be3 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:40.530974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3686b2-4fa7-4ca0-a88c-05dd5d3f1be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:40.531255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3686b2-4fa7-4ca0-a88c-05dd5d3f1be3 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:40.531989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3686b2-4fa7-4ca0-a88c-05dd5d3f1be3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:40.534188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3686b2-4fa7-4ca0-a88c-05dd5d3f1be3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:40.572681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 126/242] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:22:40 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:40.642519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5ed8d-bfa9-4234-a86c-04809f1b7ec9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:40.695576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f808f9-8e1a-4fbc-b97e-81fc74bffc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:40.696885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f808f9-8e1a-4fbc-b97e-81fc74bffc72 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:40.697325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f808f9-8e1a-4fbc-b97e-81fc74bffc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:40.697756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f808f9-8e1a-4fbc-b97e-81fc74bffc72 None admin] PATH_INFO: `/v3/users/5b0626f934fc47c7988aa6928e2f2749` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:40.714574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:40.718717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f808f9-8e1a-4fbc-b97e-81fc74bffc72 None admin] RBAC: Authorizing `identity:get_user(user_id=5b0626f934fc47c7988aa6928e2f2749)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:40.720494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f808f9-8e1a-4fbc-b97e-81fc74bffc72 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:40.724206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 117/243] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:40 2022] GET /identity/v3/users/5b0626f934fc47c7988aa6928e2f2749 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:40.728265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3686b2-4fa7-4ca0-a88c-05dd5d3f1be3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:40.803505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996b67-526f-4dfd-8ea0-beda1da46287 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:40.804347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996b67-526f-4dfd-8ea0-beda1da46287 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:40.805243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996b67-526f-4dfd-8ea0-beda1da46287 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:40.807077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 118/244] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:40.813962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bbaeb-c66a-4f62-9f22-c0ae424f5e60 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:40.814990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bbaeb-c66a-4f62-9f22-c0ae424f5e60 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:40.815743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bbaeb-c66a-4f62-9f22-c0ae424f5e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:40.838267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-102bbaeb-c66a-4f62-9f22-c0ae424f5e60 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:40.839407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-102bbaeb-c66a-4f62-9f22-c0ae424f5e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:40.869466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:40.901893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3686b2-4fa7-4ca0-a88c-05dd5d3f1be3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:40.945355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 119/245] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:40.946986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f4ace-0c79-4c7e-a896-1c048e7b70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:40.947654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f4ace-0c79-4c7e-a896-1c048e7b70c3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:40.947934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f4ace-0c79-4c7e-a896-1c048e7b70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:40.948208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f4ace-0c79-4c7e-a896-1c048e7b70c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:40.968720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bbaeb-c66a-4f62-9f22-c0ae424f5e60 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.022115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f4ace-0c79-4c7e-a896-1c048e7b70c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:41.023574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f4ace-0c79-4c7e-a896-1c048e7b70c3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:41.105734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bbaeb-c66a-4f62-9f22-c0ae424f5e60 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:41.133319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:41.146539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:41.158557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eebee1-d9f9-4d94-b5cf-130eb097597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:41.159374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eebee1-d9f9-4d94-b5cf-130eb097597c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.159664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eebee1-d9f9-4d94-b5cf-130eb097597c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.159946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eebee1-d9f9-4d94-b5cf-130eb097597c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.161532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 127/246] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:41.163522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d76b-da31-4860-8aaf-21269b4d3e69 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.163811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d76b-da31-4860-8aaf-21269b4d3e69 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.164089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d76b-da31-4860-8aaf-21269b4d3e69 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.165753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 128/247] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:41.167792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4d76b-da31-4860-8aaf-21269b4d3e69 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.173429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eebee1-d9f9-4d94-b5cf-130eb097597c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-38eebee1-d9f9-4d94-b5cf-130eb097597c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:41.181283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:41.182366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:41.183329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 120/248] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:41.184758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319651-23c1-4e14-82a7-ebc0360f9114 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.185206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319651-23c1-4e14-82a7-ebc0360f9114 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.185489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319651-23c1-4e14-82a7-ebc0360f9114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.207849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-49319651-23c1-4e14-82a7-ebc0360f9114 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:41.209189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-49319651-23c1-4e14-82a7-ebc0360f9114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:41.291412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 121/249] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:41.292890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164b150-6ff1-4e20-89b0-52a7598701a5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.293186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164b150-6ff1-4e20-89b0-52a7598701a5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.293465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164b150-6ff1-4e20-89b0-52a7598701a5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.295184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 122/250] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:41.295905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164b150-6ff1-4e20-89b0-52a7598701a5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.317661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4d76b-da31-4860-8aaf-21269b4d3e69 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:41.364714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615829b-ddec-4fdd-bdff-70043249b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:41.365595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615829b-ddec-4fdd-bdff-70043249b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.366045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615829b-ddec-4fdd-bdff-70043249b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.366505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615829b-ddec-4fdd-bdff-70043249b2f4 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.368098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615829b-ddec-4fdd-bdff-70043249b2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:41.369793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615829b-ddec-4fdd-bdff-70043249b2f4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:41.372149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 129/251] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:41 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:41.373588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e5eb-21d6-4e92-9c2a-40cc4e8c4765 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.374023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e5eb-21d6-4e92-9c2a-40cc4e8c4765 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.374445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70e5eb-21d6-4e92-9c2a-40cc4e8c4765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.394725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bf70e5eb-21d6-4e92-9c2a-40cc4e8c4765 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:41.396260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bf70e5eb-21d6-4e92-9c2a-40cc4e8c4765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:41.426424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164b150-6ff1-4e20-89b0-52a7598701a5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:41.445357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:41.453596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:41.465456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:41.466134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.466418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.466705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.467559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:41.467871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:41.469556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:41.478914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 123/252] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:41.479646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.480217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 130/253] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:41.481541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70e5eb-21d6-4e92-9c2a-40cc4e8c4765 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.587814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70e5eb-21d6-4e92-9c2a-40cc4e8c4765 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:41.590843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab7cea-7ea9-4e31-bd6a-204de4b6fbdf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:41.623322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:41.624046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.624423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.624816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.625775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] RBAC: Adding query filter params (role.id=42ddc037011a4faf942409f6f034415c, scope.project.id=66a61523318545c98b246fc2d64ad948, user.id=5b0626f934fc47c7988aa6928e2f2749) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:41.626809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:41.628184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f3558-9ec3-4d54-a61d-06d2c97288e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:41.628433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:41.629007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f3558-9ec3-4d54-a61d-06d2c97288e0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.629291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f3558-9ec3-4d54-a61d-06d2c97288e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.629567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f3558-9ec3-4d54-a61d-06d2c97288e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.634587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 131/254] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:41 2022] GET /identity/v3/role_assignments?user.id=5b0626f934fc47c7988aa6928e2f2749&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=42ddc037011a4faf942409f6f034415c => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:41.640947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f3558-9ec3-4d54-a61d-06d2c97288e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:41.641984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ae5f3558-9ec3-4d54-a61d-06d2c97288e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:41.649114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:41.650028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:41.650834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 124/255] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:41.651493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f3558-9ec3-4d54-a61d-06d2c97288e0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.705612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:41.776495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f3558-9ec3-4d54-a61d-06d2c97288e0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:41.799030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:41.818575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0db5b-9bdf-4e18-81ba-7744396547f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:41.819978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0db5b-9bdf-4e18-81ba-7744396547f5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0db5b-9bdf-4e18-81ba-7744396547f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.820897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0db5b-9bdf-4e18-81ba-7744396547f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.832606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0db5b-9bdf-4e18-81ba-7744396547f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-95a0db5b-9bdf-4e18-81ba-7744396547f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:41.841415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:41.842316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:41.843111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:41.846061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 125/256] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:22:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:41.847186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0db5b-9bdf-4e18-81ba-7744396547f5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.878970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c839697-da69-49bf-883b-a0f185543bcf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:41.931902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa294c5-7931-4e51-aeba-8bb5008866fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:41.933187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa294c5-7931-4e51-aeba-8bb5008866fc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:41.933725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa294c5-7931-4e51-aeba-8bb5008866fc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:41.934220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa294c5-7931-4e51-aeba-8bb5008866fc None admin] PATH_INFO: `/v3/users/106f47070cf6447c9d54816ba4a1aecd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:41.935636 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa294c5-7931-4e51-aeba-8bb5008866fc None admin] RBAC: Authorizing `identity:get_user(user_id=106f47070cf6447c9d54816ba4a1aecd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:41.937329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa294c5-7931-4e51-aeba-8bb5008866fc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:41.939366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 132/257] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:41 2022] GET /identity/v3/users/106f47070cf6447c9d54816ba4a1aecd => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:41.940387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa294c5-7931-4e51-aeba-8bb5008866fc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:41.973184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:41.978287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0db5b-9bdf-4e18-81ba-7744396547f5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:42.056852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:42.057551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:42.057835 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:42.058111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:42.058857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:42.059163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:42.060546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:42.082895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 126/258] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:42.084766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:42.154632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa294c5-7931-4e51-aeba-8bb5008866fc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:42.184127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:42.223037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:42.223940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:42.224392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:42.224817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:42.225732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:42.227814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:42.229388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:42.254872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 133/259] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:22:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:42.256076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:42.297305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92578321-266f-46b4-a40e-0d2a71f652d2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:42.371224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236d79-5b4e-4f52-9632-68a814a2d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:42.372098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236d79-5b4e-4f52-9632-68a814a2d566 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:42.372378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236d79-5b4e-4f52-9632-68a814a2d566 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:42.372650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236d79-5b4e-4f52-9632-68a814a2d566 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:42.373963 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44236d79-5b4e-4f52-9632-68a814a2d566 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:42.375414 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44236d79-5b4e-4f52-9632-68a814a2d566 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:42.378477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 127/260] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:42 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:42.382831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236d79-5b4e-4f52-9632-68a814a2d566 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:42.447358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:42.463475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5610d6-7fa0-41b5-9b6d-e435b27c809b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:42.527382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0db0-f16e-4a91-a288-92de83c132ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:42.528267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0db0-f16e-4a91-a288-92de83c132ed None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:42.528552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0db0-f16e-4a91-a288-92de83c132ed None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:42.529073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0db0-f16e-4a91-a288-92de83c132ed None admin] PATH_INFO: `/v3/users/b96c10d41ec24631accd317326c7bc24` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:42.531499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac0db0-f16e-4a91-a288-92de83c132ed None admin] RBAC: Authorizing `identity:get_user(user_id=b96c10d41ec24631accd317326c7bc24)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:42.533801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac0db0-f16e-4a91-a288-92de83c132ed None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:42.542417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 134/261] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:42 2022] GET /identity/v3/users/b96c10d41ec24631accd317326c7bc24 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:42.543872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0db0-f16e-4a91-a288-92de83c132ed None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:42.595853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236d79-5b4e-4f52-9632-68a814a2d566 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:42.636309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf409-0423-4cf6-8d06-aa04e971f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:42.637286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf409-0423-4cf6-8d06-aa04e971f5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:42.637564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf409-0423-4cf6-8d06-aa04e971f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:42.637838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf409-0423-4cf6-8d06-aa04e971f5b9 None admin] PATH_INFO: `/v3/users/b96c10d41ec24631accd317326c7bc24` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:42.639131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcf409-0423-4cf6-8d06-aa04e971f5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=b96c10d41ec24631accd317326c7bc24)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:42.640586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcf409-0423-4cf6-8d06-aa04e971f5b9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:42.642284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 128/262] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:42 2022] GET /identity/v3/users/b96c10d41ec24631accd317326c7bc24 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:42.643057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf409-0423-4cf6-8d06-aa04e971f5b9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:42.654294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:42.749640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:42.753808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf409-0423-4cf6-8d06-aa04e971f5b9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:42.792953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06889-fe8d-44e6-bc44-a98bc1ad478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:42.794002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06889-fe8d-44e6-bc44-a98bc1ad478d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:42.794291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06889-fe8d-44e6-bc44-a98bc1ad478d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:42.794570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06889-fe8d-44e6-bc44-a98bc1ad478d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:42.796725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0db0-f16e-4a91-a288-92de83c132ed None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:42.876664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06889-fe8d-44e6-bc44-a98bc1ad478d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:42.878413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06889-fe8d-44e6-bc44-a98bc1ad478d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:42.925581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd51fd-968d-4687-934e-6c55f74c28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:42.926582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd51fd-968d-4687-934e-6c55f74c28eb None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:42.926870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd51fd-968d-4687-934e-6c55f74c28eb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:42.927152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd51fd-968d-4687-934e-6c55f74c28eb None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948/users/106f47070cf6447c9d54816ba4a1aecd/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:42.933644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd51fd-968d-4687-934e-6c55f74c28eb None admin] RBAC: Authorizing `identity:create_grant(project_id=66a61523318545c98b246fc2d64ad948, user_id=106f47070cf6447c9d54816ba4a1aecd, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:42.935134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd51fd-968d-4687-934e-6c55f74c28eb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:42.967199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 135/263] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:42 2022] PUT /identity/v3/projects/66a61523318545c98b246fc2d64ad948/users/106f47070cf6447c9d54816ba4a1aecd/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:42.968068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd51fd-968d-4687-934e-6c55f74c28eb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:42.992311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:43.004930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 129/264] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:43.011406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06889-fe8d-44e6-bc44-a98bc1ad478d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:43.177945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd51fd-968d-4687-934e-6c55f74c28eb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:43.184855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:43.188184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06889-fe8d-44e6-bc44-a98bc1ad478d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:43.247088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770224-af77-490e-8d0a-f907f3b11559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:43.248114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770224-af77-490e-8d0a-f907f3b11559 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.248624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770224-af77-490e-8d0a-f907f3b11559 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.249122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770224-af77-490e-8d0a-f907f3b11559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.264955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35246a58-866b-4f1c-862f-aed98f8c51f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:43.264955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35246a58-866b-4f1c-862f-aed98f8c51f1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.264955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35246a58-866b-4f1c-862f-aed98f8c51f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.264955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35246a58-866b-4f1c-862f-aed98f8c51f1 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.269805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35246a58-866b-4f1c-862f-aed98f8c51f1 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:43.271304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35246a58-866b-4f1c-862f-aed98f8c51f1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:43.273344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 130/265] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:43 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:43.283009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35246a58-866b-4f1c-862f-aed98f8c51f1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:43.370999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af770224-af77-490e-8d0a-f907f3b11559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:43.372628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af770224-af77-490e-8d0a-f907f3b11559 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:43.422443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:43.466915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35246a58-866b-4f1c-862f-aed98f8c51f1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:43.504252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acb672-7ab8-4ebd-a7b6-f9d6bdcdca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:43.504906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 136/266] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:43.507249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb672-7ab8-4ebd-a7b6-f9d6bdcdca76 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.507249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb672-7ab8-4ebd-a7b6-f9d6bdcdca76 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.507435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb672-7ab8-4ebd-a7b6-f9d6bdcdca76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.508264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acb672-7ab8-4ebd-a7b6-f9d6bdcdca76 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=66a61523318545c98b246fc2d64ad948, user.id=b96c10d41ec24631accd317326c7bc24) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:43.508672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acb672-7ab8-4ebd-a7b6-f9d6bdcdca76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:43.509907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770224-af77-490e-8d0a-f907f3b11559 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:43.510211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acb672-7ab8-4ebd-a7b6-f9d6bdcdca76 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:43.512515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:43.518555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 131/267] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:43 2022] GET /identity/v3/role_assignments?user.id=b96c10d41ec24631accd317326c7bc24&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:43.597277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811f9b-ab8a-45e5-9e06-4cc2677279bc None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.597603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811f9b-ab8a-45e5-9e06-4cc2677279bc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.597843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811f9b-ab8a-45e5-9e06-4cc2677279bc None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.599267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 132/268] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:43.618968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cd44-61da-4b3b-b559-2e0f50ae8952 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.619275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cd44-61da-4b3b-b559-2e0f50ae8952 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.619539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cd44-61da-4b3b-b559-2e0f50ae8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.631602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770224-af77-490e-8d0a-f907f3b11559 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:43.669018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dd37cd44-61da-4b3b-b559-2e0f50ae8952 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:43.670359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dd37cd44-61da-4b3b-b559-2e0f50ae8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:43.681018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1177786-0d59-429c-87dd-69bfcea63725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:43.681912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1177786-0d59-429c-87dd-69bfcea63725 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.682192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1177786-0d59-429c-87dd-69bfcea63725 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.682467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1177786-0d59-429c-87dd-69bfcea63725 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.685425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1177786-0d59-429c-87dd-69bfcea63725 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:43.686929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1177786-0d59-429c-87dd-69bfcea63725 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:43.689359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 137/269] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:43 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:43.695053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1177786-0d59-429c-87dd-69bfcea63725 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:43.807683 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:43.830132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1177786-0d59-429c-87dd-69bfcea63725 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:43.838802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 133/270] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:43.872298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f35b-4267-4594-b903-9de33c5dd3a6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.872664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f35b-4267-4594-b903-9de33c5dd3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.872769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346ca78-c028-4e40-9e7e-72179a09edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:43.873070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f35b-4267-4594-b903-9de33c5dd3a6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.873428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ca78-c028-4e40-9e7e-72179a09edb9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.873718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ca78-c028-4e40-9e7e-72179a09edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.873992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ca78-c028-4e40-9e7e-72179a09edb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.874718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 134/271] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:43.874904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346ca78-c028-4e40-9e7e-72179a09edb9 None admin] RBAC: Adding query filter params (role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=66a61523318545c98b246fc2d64ad948, user.id=b96c10d41ec24631accd317326c7bc24) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:43.875147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346ca78-c028-4e40-9e7e-72179a09edb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:43.875589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41f35b-4267-4594-b903-9de33c5dd3a6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:43.876634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346ca78-c028-4e40-9e7e-72179a09edb9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:43.886646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 138/272] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:43 2022] GET /identity/v3/role_assignments?user.id=b96c10d41ec24631accd317326c7bc24&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:43.888045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8ba5-e527-4b1a-a3d4-8eb6c037bed6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:43.892979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8ba5-e527-4b1a-a3d4-8eb6c037bed6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:43.893365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8ba5-e527-4b1a-a3d4-8eb6c037bed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:43.926916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-113f8ba5-e527-4b1a-a3d4-8eb6c037bed6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:43.928158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-113f8ba5-e527-4b1a-a3d4-8eb6c037bed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:44.006834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:44.072487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41f35b-4267-4594-b903-9de33c5dd3a6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:44.083419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 139/273] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:44.114938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1031b3-0dea-452c-b1e6-6ca39b8318f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:44.115739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1031b3-0dea-452c-b1e6-6ca39b8318f4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.116018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1031b3-0dea-452c-b1e6-6ca39b8318f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.116295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1031b3-0dea-452c-b1e6-6ca39b8318f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.119527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1031b3-0dea-452c-b1e6-6ca39b8318f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:44.121030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1031b3-0dea-452c-b1e6-6ca39b8318f4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:44.121413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f8ba5-e527-4b1a-a3d4-8eb6c037bed6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:44.122769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 135/274] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:44.130093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1031b3-0dea-452c-b1e6-6ca39b8318f4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:44.224099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:44.265239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1031b3-0dea-452c-b1e6-6ca39b8318f4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:44.269198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f8ba5-e527-4b1a-a3d4-8eb6c037bed6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:44.305750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:44.316869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3c4f-ef22-4c0a-963f-b87a4e10ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:44.316869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3c4f-ef22-4c0a-963f-b87a4e10ca7b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.316869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3c4f-ef22-4c0a-963f-b87a4e10ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.316869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3c4f-ef22-4c0a-963f-b87a4e10ca7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.317800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2d293-8309-41e4-812b-26c371bf73a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:44.318560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d293-8309-41e4-812b-26c371bf73a4 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.319176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d293-8309-41e4-812b-26c371bf73a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.319537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2d293-8309-41e4-812b-26c371bf73a4 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.320334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2d293-8309-41e4-812b-26c371bf73a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:44.322278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2d293-8309-41e4-812b-26c371bf73a4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:44.330236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3c4f-ef22-4c0a-963f-b87a4e10ca7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d54d3c4f-ef22-4c0a-963f-b87a4e10ca7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:44.340249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:44.341206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:44.342027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 140/275] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:44.347105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 136/276] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:22:44 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:22:44.347907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3c4f-ef22-4c0a-963f-b87a4e10ca7b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:44.482769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3c4f-ef22-4c0a-963f-b87a4e10ca7b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:44.497368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa517-ca4c-4622-be71-8db2bbc6c282 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.497721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa517-ca4c-4622-be71-8db2bbc6c282 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.497911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aa517-ca4c-4622-be71-8db2bbc6c282 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.499644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 137/277] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:44.505215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd694b-05ca-4f37-a537-9533b57d0320 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.505515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd694b-05ca-4f37-a537-9533b57d0320 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.505759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd694b-05ca-4f37-a537-9533b57d0320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.515501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:44.524340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eccd694b-05ca-4f37-a537-9533b57d0320 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:44.525568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eccd694b-05ca-4f37-a537-9533b57d0320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:44.529383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:44.530277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.530698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.531122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.532028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:44.533100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:44.534676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:44.544260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 141/278] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:44.550150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:44.613020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 138/279] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:44.629157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd694b-05ca-4f37-a537-9533b57d0320 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:44.675366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fba384-2d7f-4192-a893-35a4e1853624 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:44.723362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7daff2-73c2-4eb2-82d0-7e839fb409b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:44.724527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7daff2-73c2-4eb2-82d0-7e839fb409b7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.724813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7daff2-73c2-4eb2-82d0-7e839fb409b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.725122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7daff2-73c2-4eb2-82d0-7e839fb409b7 None admin] PATH_INFO: `/v3/users/6e1aecf4e12e4672a22f8570f460da82` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.746846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7daff2-73c2-4eb2-82d0-7e839fb409b7 None admin] RBAC: Authorizing `identity:get_user(user_id=6e1aecf4e12e4672a22f8570f460da82)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:44.748333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7daff2-73c2-4eb2-82d0-7e839fb409b7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:44.750583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 142/280] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:44 2022] GET /identity/v3/users/6e1aecf4e12e4672a22f8570f460da82 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:44.756271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7daff2-73c2-4eb2-82d0-7e839fb409b7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:44.770241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd694b-05ca-4f37-a537-9533b57d0320 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:44.787922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:44.809159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d354a6-49c9-4e38-b726-c8122032a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:44.809961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d354a6-49c9-4e38-b726-c8122032a438 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.810243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d354a6-49c9-4e38-b726-c8122032a438 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.810526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d354a6-49c9-4e38-b726-c8122032a438 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.822544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:44.823918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d354a6-49c9-4e38-b726-c8122032a438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-90d354a6-49c9-4e38-b726-c8122032a438 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:44.834317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:44.835243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:44.836044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:44.838776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 139/281] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:44.847213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d354a6-49c9-4e38-b726-c8122032a438 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:44.887228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7daff2-73c2-4eb2-82d0-7e839fb409b7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:44.924621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:44.925758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:44.926236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:44.926727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:44.927755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] RBAC: Adding query filter params (role.id=eb3e1f4520ed4e8f873819a4830e3399, user.id=6e1aecf4e12e4672a22f8570f460da82, scope.system=all) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:44.928805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:44.930457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:44.938685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 143/282] 10.222.0.79 () {56 vars in 1308 bytes} [Fri May 27 09:22:44 2022] GET /identity/v3/role_assignments?user.id=6e1aecf4e12e4672a22f8570f460da82&scope.system=all&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:44.970235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d354a6-49c9-4e38-b726-c8122032a438 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:45.006553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:45.007241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:45.007768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:45.007768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:45.008619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:45.008959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:45.010401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:45.024397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 140/283] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:45.025798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:45.138988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635d46d-46a1-43ec-ad1c-6ecadbaabb40 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:45.150833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:45.186331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8834d9-eb0e-43c0-802e-ee40f0e19c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:45.187577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8834d9-eb0e-43c0-802e-ee40f0e19c18 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:45.188058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8834d9-eb0e-43c0-802e-ee40f0e19c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:45.189108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8834d9-eb0e-43c0-802e-ee40f0e19c18 None admin] PATH_INFO: `/v3/users/5b0626f934fc47c7988aa6928e2f2749` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:45.190510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8834d9-eb0e-43c0-802e-ee40f0e19c18 None admin] RBAC: Authorizing `identity:get_user(user_id=5b0626f934fc47c7988aa6928e2f2749)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:45.192137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8834d9-eb0e-43c0-802e-ee40f0e19c18 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:45.195289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 144/284] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:45 2022] GET /identity/v3/users/5b0626f934fc47c7988aa6928e2f2749 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:45.200032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:45.245255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:45.331094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b657ee-3f26-4fb9-93de-5f808bb3e501 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:45.378932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ec1c6-bc66-48da-8f22-abf0bed03aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:45.380160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec1c6-bc66-48da-8f22-abf0bed03aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:45.380666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec1c6-bc66-48da-8f22-abf0bed03aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:45.381173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec1c6-bc66-48da-8f22-abf0bed03aa6 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:45.382610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ec1c6-bc66-48da-8f22-abf0bed03aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:45.384264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ec1c6-bc66-48da-8f22-abf0bed03aa6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:45.388975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 141/285] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:45 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:45.392731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8834d9-eb0e-43c0-802e-ee40f0e19c18 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:45.501563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8834d9-eb0e-43c0-802e-ee40f0e19c18 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:45.551393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14db53-2ba4-4d95-92d7-7f1fd474184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:45.552713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14db53-2ba4-4d95-92d7-7f1fd474184d None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:45.553217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14db53-2ba4-4d95-92d7-7f1fd474184d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:45.553757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14db53-2ba4-4d95-92d7-7f1fd474184d None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948/users/5b0626f934fc47c7988aa6928e2f2749/roles/42ddc037011a4faf942409f6f034415c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:45.562211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14db53-2ba4-4d95-92d7-7f1fd474184d None admin] RBAC: Authorizing `identity:create_grant(project_id=66a61523318545c98b246fc2d64ad948, user_id=5b0626f934fc47c7988aa6928e2f2749, role_id=42ddc037011a4faf942409f6f034415c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:45.564470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14db53-2ba4-4d95-92d7-7f1fd474184d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:45.584915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 145/286] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:22:45 2022] PUT /identity/v3/projects/66a61523318545c98b246fc2d64ad948/users/5b0626f934fc47c7988aa6928e2f2749/roles/42ddc037011a4faf942409f6f034415c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:45.970488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57061092-1a6c-4bc5-984b-ffe0ed81add7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:45.970902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57061092-1a6c-4bc5-984b-ffe0ed81add7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:45.971109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57061092-1a6c-4bc5-984b-ffe0ed81add7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:45.972914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 142/287] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:45.979100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ee6b-50bd-41ad-a9cb-48594a8fee06 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:45.979614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ee6b-50bd-41ad-a9cb-48594a8fee06 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:45.979717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ee6b-50bd-41ad-a9cb-48594a8fee06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:46.004790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5543ee6b-50bd-41ad-a9cb-48594a8fee06 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:46.006043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5543ee6b-50bd-41ad-a9cb-48594a8fee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:46.041398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:46.094684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 146/288] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:46.127462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57061092-1a6c-4bc5-984b-ffe0ed81add7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:46.252896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57061092-1a6c-4bc5-984b-ffe0ed81add7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:46.255577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:46.289210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbffa5f-f2cc-4ffc-a03e-6855ca25dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:46.290003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbffa5f-f2cc-4ffc-a03e-6855ca25dea0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:46.290284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbffa5f-f2cc-4ffc-a03e-6855ca25dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:46.290560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbffa5f-f2cc-4ffc-a03e-6855ca25dea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:46.301146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbffa5f-f2cc-4ffc-a03e-6855ca25dea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2bbffa5f-f2cc-4ffc-a03e-6855ca25dea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:46.308965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:46.309844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:46.310644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 143/289] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:46.317035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ee6b-50bd-41ad-a9cb-48594a8fee06 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:46.474936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ee6b-50bd-41ad-a9cb-48594a8fee06 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:46.521984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:46.522987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:46.523485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:46.523950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:46.524911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:46.525424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:46.527025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:46.540203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 147/290] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:46.545933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbffa5f-f2cc-4ffc-a03e-6855ca25dea0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:46.691334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbffa5f-f2cc-4ffc-a03e-6855ca25dea0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:46.739661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ed2a-279e-43ae-ad9c-aa8a22ecb820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:46.740535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ed2a-279e-43ae-ad9c-aa8a22ecb820 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:46.740817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ed2a-279e-43ae-ad9c-aa8a22ecb820 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:46.741116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ed2a-279e-43ae-ad9c-aa8a22ecb820 None admin] PATH_INFO: `/v3/users/106f47070cf6447c9d54816ba4a1aecd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:46.745560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ed2a-279e-43ae-ad9c-aa8a22ecb820 None admin] RBAC: Authorizing `identity:get_user(user_id=106f47070cf6447c9d54816ba4a1aecd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:46.747041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ed2a-279e-43ae-ad9c-aa8a22ecb820 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:46.749087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 144/291] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:46 2022] GET /identity/v3/users/106f47070cf6447c9d54816ba4a1aecd => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:46.754957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:46.804535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:46.892969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3124edc-459c-4a0a-85a4-44f0db38b209 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:46.935402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29678601-215f-438b-bf41-2e867eaae109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:46.936078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678601-215f-438b-bf41-2e867eaae109 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:46.936360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678601-215f-438b-bf41-2e867eaae109 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:46.936640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678601-215f-438b-bf41-2e867eaae109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.036465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29678601-215f-438b-bf41-2e867eaae109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:47.038027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29678601-215f-438b-bf41-2e867eaae109 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:47.066425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:47.149023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 148/292] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:47.154544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76996a4-24f3-44c3-be7f-3a3632991f36 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.154997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76996a4-24f3-44c3-be7f-3a3632991f36 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.155183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76996a4-24f3-44c3-be7f-3a3632991f36 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.156594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 145/293] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:47.158058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29678601-215f-438b-bf41-2e867eaae109 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:47.162006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746fd8-7a63-4529-9db4-9b54fe852a51 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.162537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746fd8-7a63-4529-9db4-9b54fe852a51 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.163025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746fd8-7a63-4529-9db4-9b54fe852a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.205027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a3746fd8-7a63-4529-9db4-9b54fe852a51 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:47.206614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a3746fd8-7a63-4529-9db4-9b54fe852a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:47.265456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:47.300271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29678601-215f-438b-bf41-2e867eaae109 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:47.311036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 146/294] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:47.333285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746fd8-7a63-4529-9db4-9b54fe852a51 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:47.377210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:47.389984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e14330-e6e6-4e6f-96c9-ccbfff8ba204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:47.390879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e14330-e6e6-4e6f-96c9-ccbfff8ba204 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.391172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e14330-e6e6-4e6f-96c9-ccbfff8ba204 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.391507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e14330-e6e6-4e6f-96c9-ccbfff8ba204 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.397787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e14330-e6e6-4e6f-96c9-ccbfff8ba204 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:47.399566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e14330-e6e6-4e6f-96c9-ccbfff8ba204 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:47.401346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 149/295] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:47 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:47.402941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92d2a-b13b-4d5b-8721-c8d89c2fe54c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.403428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92d2a-b13b-4d5b-8721-c8d89c2fe54c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.403907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92d2a-b13b-4d5b-8721-c8d89c2fe54c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.405642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 150/296] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:47.411250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92d2a-b13b-4d5b-8721-c8d89c2fe54c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:47.453474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746fd8-7a63-4529-9db4-9b54fe852a51 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:47.497771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661aedfd-6719-43ac-bde0-28faed846cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:47.498960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661aedfd-6719-43ac-bde0-28faed846cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.499396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661aedfd-6719-43ac-bde0-28faed846cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.499851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661aedfd-6719-43ac-bde0-28faed846cc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.502021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661aedfd-6719-43ac-bde0-28faed846cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:47.503795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661aedfd-6719-43ac-bde0-28faed846cc6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:47.506736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 147/297] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:47.508119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426eb40-63b9-439d-9d8f-a7ed9a402bfb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.508563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426eb40-63b9-439d-9d8f-a7ed9a402bfb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.509013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426eb40-63b9-439d-9d8f-a7ed9a402bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.529723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1426eb40-63b9-439d-9d8f-a7ed9a402bfb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:47.531468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1426eb40-63b9-439d-9d8f-a7ed9a402bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:47.549696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92d2a-b13b-4d5b-8721-c8d89c2fe54c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:47.562259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:47.599303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:47.600126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.600506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.601085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.602743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] RBAC: Adding query filter params (role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=66a61523318545c98b246fc2d64ad948, user.id=106f47070cf6447c9d54816ba4a1aecd) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:47.603321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:47.605599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:47.615196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 151/298] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:47 2022] GET /identity/v3/role_assignments?user.id=106f47070cf6447c9d54816ba4a1aecd&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:47.616245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:47.627306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 148/299] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:47.676436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426eb40-63b9-439d-9d8f-a7ed9a402bfb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:47.715057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:47.806881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f5739-69b3-4476-82d0-173cf75d579e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:47.873397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426eb40-63b9-439d-9d8f-a7ed9a402bfb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:47.874244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d38de-ed5c-42af-b742-cd5fa1e4087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:47.874935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d38de-ed5c-42af-b742-cd5fa1e4087f None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.875221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d38de-ed5c-42af-b742-cd5fa1e4087f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.875502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d38de-ed5c-42af-b742-cd5fa1e4087f None admin] PATH_INFO: `/v3/groups` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.876801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d38de-ed5c-42af-b742-cd5fa1e4087f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:47.878583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d38de-ed5c-42af-b742-cd5fa1e4087f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:47.901173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 152/300] 10.222.0.79 () {60 vars in 1134 bytes} [Fri May 27 09:22:47 2022] POST /identity/v3/groups => generated 229 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:47.922384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753740-9ee0-4485-b559-edd5c04895b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:47.923395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753740-9ee0-4485-b559-edd5c04895b4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:47.923682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753740-9ee0-4485-b559-edd5c04895b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:47.923960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753740-9ee0-4485-b559-edd5c04895b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:47.937159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753740-9ee0-4485-b559-edd5c04895b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-64753740-9ee0-4485-b559-edd5c04895b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:47.946140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:47.947120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:47.947925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:47.949777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 149/301] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:47.954474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d38de-ed5c-42af-b742-cd5fa1e4087f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.074235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d38de-ed5c-42af-b742-cd5fa1e4087f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:48.098100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:48.116594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715aaf-8d4c-45fe-a084-07894622e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:48.117341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715aaf-8d4c-45fe-a084-07894622e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.117611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715aaf-8d4c-45fe-a084-07894622e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.117891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715aaf-8d4c-45fe-a084-07894622e6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.118687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24715aaf-8d4c-45fe-a084-07894622e6f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:48.119001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24715aaf-8d4c-45fe-a084-07894622e6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:48.120440 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24715aaf-8d4c-45fe-a084-07894622e6f7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:48.130687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 153/302] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:48.136751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753740-9ee0-4485-b559-edd5c04895b4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.162391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:48.210201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b9ae-53ab-41a6-8efe-669220a32b0b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.210594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b9ae-53ab-41a6-8efe-669220a32b0b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.210882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3b9ae-53ab-41a6-8efe-669220a32b0b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.212658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 154/303] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:48.219122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595eb9-c096-4462-9474-c79737e4e0d8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.219413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595eb9-c096-4462-9474-c79737e4e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.219756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595eb9-c096-4462-9474-c79737e4e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.239080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c9595eb9-c096-4462-9474-c79737e4e0d8 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:48.240627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c9595eb9-c096-4462-9474-c79737e4e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:48.262708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753740-9ee0-4485-b559-edd5c04895b4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:48.307314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b99e31-667e-4e57-ba2e-287b76e3627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:48.308685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b99e31-667e-4e57-ba2e-287b76e3627d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.309072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b99e31-667e-4e57-ba2e-287b76e3627d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.309422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b99e31-667e-4e57-ba2e-287b76e3627d None admin] PATH_INFO: `/v3/users/5e22265bd7f944d18c23de76486ee604` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.324379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b99e31-667e-4e57-ba2e-287b76e3627d None admin] RBAC: Authorizing `identity:get_user(user_id=5e22265bd7f944d18c23de76486ee604)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:48.325890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b99e31-667e-4e57-ba2e-287b76e3627d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:48.327619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 150/304] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:48 2022] GET /identity/v3/users/5e22265bd7f944d18c23de76486ee604 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:48.332874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb963c-628b-4763-8e7c-549e1572f609 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.332874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb963c-628b-4763-8e7c-549e1572f609 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.332874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb963c-628b-4763-8e7c-549e1572f609 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.332874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 151/305] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:48.336056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb963c-628b-4763-8e7c-549e1572f609 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.337373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 155/306] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:48.338650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f707-eb32-4fbf-a3ce-26f6411538d2 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.338946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f707-eb32-4fbf-a3ce-26f6411538d2 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.339227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83f707-eb32-4fbf-a3ce-26f6411538d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.360558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3b83f707-eb32-4fbf-a3ce-26f6411538d2 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:48.361919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3b83f707-eb32-4fbf-a3ce-26f6411538d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:48.428120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:48.433733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 156/307] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:48.437009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83f707-eb32-4fbf-a3ce-26f6411538d2 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.463488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb963c-628b-4763-8e7c-549e1572f609 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:48.479687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:48.499481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:48.500137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.500516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.501050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.501719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] RBAC: Adding query filter params (role.id=42ddc037011a4faf942409f6f034415c, user.id=5e22265bd7f944d18c23de76486ee604, scope.system=all) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:48.502032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:48.503470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:48.508505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 152/308] 10.222.0.79 () {56 vars in 1308 bytes} [Fri May 27 09:22:48 2022] GET /identity/v3/role_assignments?user.id=5e22265bd7f944d18c23de76486ee604&scope.system=all&role.id=42ddc037011a4faf942409f6f034415c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:48.513900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.544958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83f707-eb32-4fbf-a3ce-26f6411538d2 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:48.594286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee47e1a-576f-4a61-8d9e-0fce3fc5381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:48.595661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee47e1a-576f-4a61-8d9e-0fce3fc5381f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.595946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee47e1a-576f-4a61-8d9e-0fce3fc5381f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.596223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee47e1a-576f-4a61-8d9e-0fce3fc5381f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.612133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee47e1a-576f-4a61-8d9e-0fce3fc5381f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-bee47e1a-576f-4a61-8d9e-0fce3fc5381f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:48.622297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:48.623272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:48.624173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:48.629389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 157/309] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:48.630374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee47e1a-576f-4a61-8d9e-0fce3fc5381f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.643027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95eb85-6189-45f5-8cd7-4821c89f1135 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:48.680262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6d58d-0f0c-45e7-940d-21fa8a54fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:48.681524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d58d-0f0c-45e7-940d-21fa8a54fc62 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.682049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d58d-0f0c-45e7-940d-21fa8a54fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.682563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d58d-0f0c-45e7-940d-21fa8a54fc62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.697666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6d58d-0f0c-45e7-940d-21fa8a54fc62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a1f6d58d-0f0c-45e7-940d-21fa8a54fc62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:48.706378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:48.707281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:48.708122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 153/310] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:48.714945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6d58d-0f0c-45e7-940d-21fa8a54fc62 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.721156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:48.768061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee47e1a-576f-4a61-8d9e-0fce3fc5381f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:48.770649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:48.815609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:48.817074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.817656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.818085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.819207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:48.819979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:48.821981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:48.825430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6d58d-0f0c-45e7-940d-21fa8a54fc62 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:48.833316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 158/311] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:48.840501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.867672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:48.868528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.868881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.869244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:48.870061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:48.870435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:48.871931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:48.885715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 154/312] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:48.886781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:48.961243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27076fe-328d-4e1f-823c-6b505e680dcd None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:48.973207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:48.998295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974746fb-f0e5-4443-b390-004b94c86cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:48.999218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974746fb-f0e5-4443-b390-004b94c86cde None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:48.999501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974746fb-f0e5-4443-b390-004b94c86cde None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:48.999774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974746fb-f0e5-4443-b390-004b94c86cde None admin] PATH_INFO: `/v3/users/6e1aecf4e12e4672a22f8570f460da82` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:49.001138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974746fb-f0e5-4443-b390-004b94c86cde None admin] RBAC: Authorizing `identity:get_user(user_id=6e1aecf4e12e4672a22f8570f460da82)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:49.002946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974746fb-f0e5-4443-b390-004b94c86cde None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:49.009169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 159/313] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:48 2022] GET /identity/v3/users/6e1aecf4e12e4672a22f8570f460da82 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:49.010334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974746fb-f0e5-4443-b390-004b94c86cde None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:49.025034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534385f-eb8d-4111-adb4-0abd098871a4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:49.043067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:49.075774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3a5b-bdb2-4338-ad09-2a0e0b111336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:49.076856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3a5b-bdb2-4338-ad09-2a0e0b111336 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:49.077313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3a5b-bdb2-4338-ad09-2a0e0b111336 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:49.077432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3a5b-bdb2-4338-ad09-2a0e0b111336 None admin] PATH_INFO: `/v3/users/5b0626f934fc47c7988aa6928e2f2749` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:49.078735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d3a5b-bdb2-4338-ad09-2a0e0b111336 None admin] RBAC: Authorizing `identity:get_user(user_id=5b0626f934fc47c7988aa6928e2f2749)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:49.080216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d3a5b-bdb2-4338-ad09-2a0e0b111336 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:49.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 155/314] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:48 2022] GET /identity/v3/users/5b0626f934fc47c7988aa6928e2f2749 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:49.088561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3a5b-bdb2-4338-ad09-2a0e0b111336 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:49.130991 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974746fb-f0e5-4443-b390-004b94c86cde None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:49.164762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e89b0-7ffd-48de-951a-9751f135feda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:49.165701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e89b0-7ffd-48de-951a-9751f135feda None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:49.165985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e89b0-7ffd-48de-951a-9751f135feda None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:49.166269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e89b0-7ffd-48de-951a-9751f135feda None admin] PATH_INFO: `/v3/system/users/6e1aecf4e12e4672a22f8570f460da82/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:49.168160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e89b0-7ffd-48de-951a-9751f135feda None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6e1aecf4e12e4672a22f8570f460da82, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:49.169396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e89b0-7ffd-48de-951a-9751f135feda None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:49.189091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 160/315] 10.222.0.79 () {58 vars in 1334 bytes} [Fri May 27 09:22:49 2022] PUT /identity/v3/system/users/6e1aecf4e12e4672a22f8570f460da82/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:49.219749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3a5b-bdb2-4338-ad09-2a0e0b111336 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:49.256191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:49.263214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ca5e-eee3-4a94-ab9a-c1276b872196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:49.264296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ca5e-eee3-4a94-ab9a-c1276b872196 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:49.264806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ca5e-eee3-4a94-ab9a-c1276b872196 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:49.265350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ca5e-eee3-4a94-ab9a-c1276b872196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:49.343243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ca5e-eee3-4a94-ab9a-c1276b872196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:49.345362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ca5e-eee3-4a94-ab9a-c1276b872196 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:49.455889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 156/316] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:49.467765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e89b0-7ffd-48de-951a-9751f135feda None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:49.568405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:49.574387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e89b0-7ffd-48de-951a-9751f135feda None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:49.610597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd381f71-4607-478f-a70c-0a8464e7d582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:49.611468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381f71-4607-478f-a70c-0a8464e7d582 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:49.611753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381f71-4607-478f-a70c-0a8464e7d582 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:49.612033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381f71-4607-478f-a70c-0a8464e7d582 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:49.613255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd381f71-4607-478f-a70c-0a8464e7d582 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:49.614688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd381f71-4607-478f-a70c-0a8464e7d582 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:49.616617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 161/317] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:49 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:49.622513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ca5e-eee3-4a94-ab9a-c1276b872196 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:49.654163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:49.736308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ca5e-eee3-4a94-ab9a-c1276b872196 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:49.773304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c961f-18f7-4999-aeed-f04bbcf0dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:49.773969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c961f-18f7-4999-aeed-f04bbcf0dc30 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:49.774253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c961f-18f7-4999-aeed-f04bbcf0dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:49.774536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c961f-18f7-4999-aeed-f04bbcf0dc30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:49.775372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c961f-18f7-4999-aeed-f04bbcf0dc30 None admin] RBAC: Adding query filter params (role.id=42ddc037011a4faf942409f6f034415c, scope.project.id=66a61523318545c98b246fc2d64ad948, user.id=5b0626f934fc47c7988aa6928e2f2749) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:49.775687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c961f-18f7-4999-aeed-f04bbcf0dc30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:49.777164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c961f-18f7-4999-aeed-f04bbcf0dc30 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:49.784186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 157/318] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:22:49 2022] GET /identity/v3/role_assignments?user.id=5b0626f934fc47c7988aa6928e2f2749&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=42ddc037011a4faf942409f6f034415c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:50.271042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16962a3b-1f5b-4529-a4d9-4df76a837765 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:50.271560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16962a3b-1f5b-4529-a4d9-4df76a837765 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:50.271634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16962a3b-1f5b-4529-a4d9-4df76a837765 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:50.273276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 162/319] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:50.278329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96946c34-315a-4bfa-bf23-78592b22e51f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:50.278740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96946c34-315a-4bfa-bf23-78592b22e51f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:50.279031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96946c34-315a-4bfa-bf23-78592b22e51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:50.296590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-96946c34-315a-4bfa-bf23-78592b22e51f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:50.300233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-96946c34-315a-4bfa-bf23-78592b22e51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:50.367781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 158/320] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:50.390898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16962a3b-1f5b-4529-a4d9-4df76a837765 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:50.496241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16962a3b-1f5b-4529-a4d9-4df76a837765 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:50.530294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ac06d-64c7-4762-98e7-c7bfefca64d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:50.531013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac06d-64c7-4762-98e7-c7bfefca64d1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:50.531294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac06d-64c7-4762-98e7-c7bfefca64d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:50.531568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac06d-64c7-4762-98e7-c7bfefca64d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:50.532756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ac06d-64c7-4762-98e7-c7bfefca64d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:50.534222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ac06d-64c7-4762-98e7-c7bfefca64d1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:50.536035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 163/321] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:22:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:50.541395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96946c34-315a-4bfa-bf23-78592b22e51f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:50.568271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:50.645798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96946c34-315a-4bfa-bf23-78592b22e51f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:50.679058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fa7ea-f11c-4677-a4da-f83e2a1d278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:50.679722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa7ea-f11c-4677-a4da-f83e2a1d278d None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:50.680006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa7ea-f11c-4677-a4da-f83e2a1d278d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:50.680286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa7ea-f11c-4677-a4da-f83e2a1d278d None admin] PATH_INFO: `/v3/groups` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:50.681006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fa7ea-f11c-4677-a4da-f83e2a1d278d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:50.682459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fa7ea-f11c-4677-a4da-f83e2a1d278d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:50.697649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 159/322] 10.222.0.79 () {60 vars in 1134 bytes} [Fri May 27 09:22:50 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:22:50.774415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770803-8a63-4821-b6ea-e28a0d6ef6af None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:50.774730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770803-8a63-4821-b6ea-e28a0d6ef6af None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:50.774978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770803-8a63-4821-b6ea-e28a0d6ef6af None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:50.776540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 164/323] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:50.782398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01ec7-adb9-4b11-b602-4e8431ac6d9e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:50.782666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01ec7-adb9-4b11-b602-4e8431ac6d9e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:50.782882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01ec7-adb9-4b11-b602-4e8431ac6d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:50.800531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-26c01ec7-adb9-4b11-b602-4e8431ac6d9e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:50.801764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-26c01ec7-adb9-4b11-b602-4e8431ac6d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:50.873432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 160/324] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:50.896312 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770803-8a63-4821-b6ea-e28a0d6ef6af None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:50.930336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:51.010482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770803-8a63-4821-b6ea-e28a0d6ef6af None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:51.046184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead903b1-3924-402e-bc9c-f41f672f0737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:51.046915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead903b1-3924-402e-bc9c-f41f672f0737 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:51.047247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead903b1-3924-402e-bc9c-f41f672f0737 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:51.047531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead903b1-3924-402e-bc9c-f41f672f0737 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:51.058609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead903b1-3924-402e-bc9c-f41f672f0737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ead903b1-3924-402e-bc9c-f41f672f0737 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:51.067077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:51.068008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:51.068819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 165/325] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:51.074471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c01ec7-adb9-4b11-b602-4e8431ac6d9e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:51.093475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:51.185426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c01ec7-adb9-4b11-b602-4e8431ac6d9e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:51.226894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:51.227899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:51.228362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:51.228862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:51.229786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:51.230270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:51.231889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:51.241211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 161/326] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:51.246773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead903b1-3924-402e-bc9c-f41f672f0737 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:51.379009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:51.389560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead903b1-3924-402e-bc9c-f41f672f0737 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:51.434304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11673c-c32f-4c4b-a2b6-49d19f8f807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:51.435211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11673c-c32f-4c4b-a2b6-49d19f8f807f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:51.435510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11673c-c32f-4c4b-a2b6-49d19f8f807f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:51.435773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11673c-c32f-4c4b-a2b6-49d19f8f807f None admin] PATH_INFO: `/v3/users/5e22265bd7f944d18c23de76486ee604` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:51.437057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11673c-c32f-4c4b-a2b6-49d19f8f807f None admin] RBAC: Authorizing `identity:get_user(user_id=5e22265bd7f944d18c23de76486ee604)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:51.438643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11673c-c32f-4c4b-a2b6-49d19f8f807f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:51.440668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 166/327] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:51 2022] GET /identity/v3/users/5e22265bd7f944d18c23de76486ee604 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:51.445998 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:51.540590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:51.554137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7f25-e333-4759-a233-e9da1b4ca580 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:51.554426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7f25-e333-4759-a233-e9da1b4ca580 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:51.554744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7f25-e333-4759-a233-e9da1b4ca580 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:51.556514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 167/328] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:51.561981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d9d9-0cde-4297-9c97-b20998270fb1 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:51.562336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d9d9-0cde-4297-9c97-b20998270fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:51.562624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d9d9-0cde-4297-9c97-b20998270fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:51.564787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919278e-97ae-4e4b-b502-6d8aa201209d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:51.589123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9192d9d9-0cde-4297-9c97-b20998270fb1 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:51.590338 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9192d9d9-0cde-4297-9c97-b20998270fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:51.611497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cdf02-0a57-4f2e-b3c1-b839bbe687e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:51.612366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cdf02-0a57-4f2e-b3c1-b839bbe687e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:51.612647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cdf02-0a57-4f2e-b3c1-b839bbe687e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:51.613065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cdf02-0a57-4f2e-b3c1-b839bbe687e6 None admin] PATH_INFO: `/v3/system/users/5e22265bd7f944d18c23de76486ee604/roles/42ddc037011a4faf942409f6f034415c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:51.614720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cdf02-0a57-4f2e-b3c1-b839bbe687e6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5e22265bd7f944d18c23de76486ee604, role_id=42ddc037011a4faf942409f6f034415c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:51.616296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cdf02-0a57-4f2e-b3c1-b839bbe687e6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:51.626921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 162/329] 10.222.0.79 () {58 vars in 1334 bytes} [Fri May 27 09:22:51 2022] PUT /identity/v3/system/users/5e22265bd7f944d18c23de76486ee604/roles/42ddc037011a4faf942409f6f034415c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:22:51.674134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 168/330] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:51.718366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cdf02-0a57-4f2e-b3c1-b839bbe687e6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:51.849379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cdf02-0a57-4f2e-b3c1-b839bbe687e6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:51.888957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c1775-2e55-4652-8fff-8928af07eebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:51.889776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c1775-2e55-4652-8fff-8928af07eebf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:51.890060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c1775-2e55-4652-8fff-8928af07eebf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:51.890339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c1775-2e55-4652-8fff-8928af07eebf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:51.901891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c1775-2e55-4652-8fff-8928af07eebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0b9c1775-2e55-4652-8fff-8928af07eebf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:51.910396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:51.911334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:51.912136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 163/331] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:51.920813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192d9d9-0cde-4297-9c97-b20998270fb1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:52.055044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:52.067308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192d9d9-0cde-4297-9c97-b20998270fb1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:52.108137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:52.108791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:52.109105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:52.109383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:52.110689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:52.110998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:52.112378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:52.121427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 169/332] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:52.126805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c1775-2e55-4652-8fff-8928af07eebf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:52.130794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:52.266890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c1775-2e55-4652-8fff-8928af07eebf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:52.337839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6eff62-622b-4d14-b674-f25c276278a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:52.338752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eff62-622b-4d14-b674-f25c276278a9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:52.339040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eff62-622b-4d14-b674-f25c276278a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:52.339321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eff62-622b-4d14-b674-f25c276278a9 None admin] PATH_INFO: `/v3/users/6e1aecf4e12e4672a22f8570f460da82` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:52.340614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6eff62-622b-4d14-b674-f25c276278a9 None admin] RBAC: Authorizing `identity:get_user(user_id=6e1aecf4e12e4672a22f8570f460da82)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:52.342164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6eff62-622b-4d14-b674-f25c276278a9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:52.344142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 164/333] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:52 2022] GET /identity/v3/users/6e1aecf4e12e4672a22f8570f460da82 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:52.349644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:52.488420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f02c65-a447-41a9-bc05-02055f0d8957 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:52.527589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5b02c-fa5c-47d2-87f5-d0a70cab23a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:52.528256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b02c-fa5c-47d2-87f5-d0a70cab23a6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:52.528545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b02c-fa5c-47d2-87f5-d0a70cab23a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:52.528843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b02c-fa5c-47d2-87f5-d0a70cab23a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:52.529686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5b02c-fa5c-47d2-87f5-d0a70cab23a6 None admin] RBAC: Adding query filter params (role.id=eb3e1f4520ed4e8f873819a4830e3399, user.id=6e1aecf4e12e4672a22f8570f460da82, scope.system=all) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:52.530000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5b02c-fa5c-47d2-87f5-d0a70cab23a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:52.531447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5b02c-fa5c-47d2-87f5-d0a70cab23a6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:52.546409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 170/334] 10.222.0.79 () {56 vars in 1308 bytes} [Fri May 27 09:22:52 2022] GET /identity/v3/role_assignments?user.id=6e1aecf4e12e4672a22f8570f460da82&scope.system=all&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:54.002218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929111-b27a-4031-9dbc-199387a11d66 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:54.002845 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929111-b27a-4031-9dbc-199387a11d66 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:54.003101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929111-b27a-4031-9dbc-199387a11d66 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:54.004844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 165/335] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:54.011479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c05d-f359-4d5a-958e-ad33b196ec0f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:54.012010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c05d-f359-4d5a-958e-ad33b196ec0f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:54.012104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c05d-f359-4d5a-958e-ad33b196ec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:54.034705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f733c05d-f359-4d5a-958e-ad33b196ec0f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:54.036004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f733c05d-f359-4d5a-958e-ad33b196ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:54.041965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:54.132728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 171/336] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:54.183288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a929111-b27a-4031-9dbc-199387a11d66 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:54.259424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:54.305625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a929111-b27a-4031-9dbc-199387a11d66 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:54.351680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742654-3789-42ce-a39d-f23823186823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:54.352539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742654-3789-42ce-a39d-f23823186823 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:54.352848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742654-3789-42ce-a39d-f23823186823 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:54.353131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742654-3789-42ce-a39d-f23823186823 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:54.370634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742654-3789-42ce-a39d-f23823186823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a8742654-3789-42ce-a39d-f23823186823 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:54.378603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:54.379628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:54.380483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 166/337] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:54.385645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c05d-f359-4d5a-958e-ad33b196ec0f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:54.510117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c05d-f359-4d5a-958e-ad33b196ec0f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:54.517774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048534-4298-418e-9271-774447caf460 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:54.518062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048534-4298-418e-9271-774447caf460 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:54.518341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048534-4298-418e-9271-774447caf460 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:54.519720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 167/338] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:54.524897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b57a2-7d28-423c-afad-3fc575c8b98f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:54.525192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b57a2-7d28-423c-afad-3fc575c8b98f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:54.525474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b57a2-7d28-423c-afad-3fc575c8b98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:54.555945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1b0b57a2-7d28-423c-afad-3fc575c8b98f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:54.557175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b0b57a2-7d28-423c-afad-3fc575c8b98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:54.582266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:54.582972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:54.583260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:54.583534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:54.584317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:54.584627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:54.586128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:54.611176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 172/339] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:54.617456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:54.621869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:54.702390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 168/340] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:22:54.742198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b57a2-7d28-423c-afad-3fc575c8b98f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:54.791920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79ef4e-c434-4ae1-8d2c-620d35622b03 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:54.847488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecd630-05da-4863-aed4-af5011236ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:54.848172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecd630-05da-4863-aed4-af5011236ddc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:54.848462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecd630-05da-4863-aed4-af5011236ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:54.848750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecd630-05da-4863-aed4-af5011236ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:54.881333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:54.927686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecd630-05da-4863-aed4-af5011236ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:54.930350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecd630-05da-4863-aed4-af5011236ddc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:54.932425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:54.971657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b57a2-7d28-423c-afad-3fc575c8b98f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:55.039763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 173/341] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:55.041580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33945f8f-1bd2-4078-a234-cba5634fc8e6 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.041875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33945f8f-1bd2-4078-a234-cba5634fc8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.042210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33945f8f-1bd2-4078-a234-cba5634fc8e6 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.043705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 174/342] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:55.049397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33945f8f-1bd2-4078-a234-cba5634fc8e6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:55.070161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ddc01-ae14-46ff-95bb-09ef85d2d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:55.070984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ddc01-ae14-46ff-95bb-09ef85d2d037 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.071274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ddc01-ae14-46ff-95bb-09ef85d2d037 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.071553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ddc01-ae14-46ff-95bb-09ef85d2d037 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.084490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ddc01-ae14-46ff-95bb-09ef85d2d037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-006ddc01-ae14-46ff-95bb-09ef85d2d037 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:55.092605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:55.093569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:55.094937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 169/343] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:55.096126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281b4f-97eb-48c1-8af5-22569b232594 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.096300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281b4f-97eb-48c1-8af5-22569b232594 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.096556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1281b4f-97eb-48c1-8af5-22569b232594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.116472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c1281b4f-97eb-48c1-8af5-22569b232594 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:55.119445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c1281b4f-97eb-48c1-8af5-22569b232594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:55.175753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33945f8f-1bd2-4078-a234-cba5634fc8e6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:55.177908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:55.191898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 170/344] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:55.193384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd57e4-6118-4f21-9b93-99084944e9d1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.194530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd57e4-6118-4f21-9b93-99084944e9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.194886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd57e4-6118-4f21-9b93-99084944e9d1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.196175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 171/345] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:55.196897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd57e4-6118-4f21-9b93-99084944e9d1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:55.238625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae184a-bc62-4dd7-8929-f140ed777d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:55.239507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae184a-bc62-4dd7-8929-f140ed777d92 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.239796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae184a-bc62-4dd7-8929-f140ed777d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.240591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae184a-bc62-4dd7-8929-f140ed777d92 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.242186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae184a-bc62-4dd7-8929-f140ed777d92 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:55.244280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae184a-bc62-4dd7-8929-f140ed777d92 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:55.246894 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 175/346] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:55 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:55.248368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6bc5-8ce2-475d-9688-4c939b9729aa None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.248658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6bc5-8ce2-475d-9688-4c939b9729aa None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.249006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6bc5-8ce2-475d-9688-4c939b9729aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.270519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b35c6bc5-8ce2-475d-9688-4c939b9729aa None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:55.272496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b35c6bc5-8ce2-475d-9688-4c939b9729aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:55.281224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:55.340977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd57e4-6118-4f21-9b93-99084944e9d1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:55.367486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 176/347] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:55.368394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c6bc5-8ce2-475d-9688-4c939b9729aa None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:55.410807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee58f-d938-4216-b604-3c057188caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:55.411486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee58f-d938-4216-b604-3c057188caef None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.411771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee58f-d938-4216-b604-3c057188caef None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.412047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eee58f-d938-4216-b604-3c057188caef None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.412800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee58f-d938-4216-b604-3c057188caef None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:55.413151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee58f-d938-4216-b604-3c057188caef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:55.414649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eee58f-d938-4216-b604-3c057188caef None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:55.428366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 172/348] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:55.429313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee58f-d938-4216-b604-3c057188caef None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:55.496811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:55.502217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c6bc5-8ce2-475d-9688-4c939b9729aa None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:55.548353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe454e8-99e8-4008-9ecb-3bf632bb0a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:55.549221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe454e8-99e8-4008-9ecb-3bf632bb0a0c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.549506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe454e8-99e8-4008-9ecb-3bf632bb0a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.549787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe454e8-99e8-4008-9ecb-3bf632bb0a0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.566285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe454e8-99e8-4008-9ecb-3bf632bb0a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:55.567126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eee58f-d938-4216-b604-3c057188caef None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7fe454e8-99e8-4008-9ecb-3bf632bb0a0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:55.575925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:55.577078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 177/349] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:22:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:55.578104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe454e8-99e8-4008-9ecb-3bf632bb0a0c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:55.591877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:55.623585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b8e85-7574-4bae-81f2-3dafbc90b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:55.624598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8e85-7574-4bae-81f2-3dafbc90b2eb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.624934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8e85-7574-4bae-81f2-3dafbc90b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.625217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8e85-7574-4bae-81f2-3dafbc90b2eb None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.635112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b8e85-7574-4bae-81f2-3dafbc90b2eb None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:55.635112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b8e85-7574-4bae-81f2-3dafbc90b2eb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:55.637636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 173/350] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:22:55 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:55.638514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b8e85-7574-4bae-81f2-3dafbc90b2eb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:55.716938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe454e8-99e8-4008-9ecb-3bf632bb0a0c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:55.768055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681d6e2-8386-47d3-9b53-b2eaef10926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:55.768882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d6e2-8386-47d3-9b53-b2eaef10926b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.769178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d6e2-8386-47d3-9b53-b2eaef10926b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.769463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d6e2-8386-47d3-9b53-b2eaef10926b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.771162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b8e85-7574-4bae-81f2-3dafbc90b2eb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:55.782999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681d6e2-8386-47d3-9b53-b2eaef10926b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d681d6e2-8386-47d3-9b53-b2eaef10926b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:55.791441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:55.792356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:55.793657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 178/351] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:55.794823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086008a-f3db-4cc5-b32c-dcd69808e23a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.794823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086008a-f3db-4cc5-b32c-dcd69808e23a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.795009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086008a-f3db-4cc5-b32c-dcd69808e23a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.796332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 179/352] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:55.797012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086008a-f3db-4cc5-b32c-dcd69808e23a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:55.818094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466975a8-211e-43ad-bc87-672c3bded1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:55.818679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466975a8-211e-43ad-bc87-672c3bded1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.818964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466975a8-211e-43ad-bc87-672c3bded1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.822008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466975a8-211e-43ad-bc87-672c3bded1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.829224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:55.877015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:55.906541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466975a8-211e-43ad-bc87-672c3bded1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:55.908060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466975a8-211e-43ad-bc87-672c3bded1f4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:55.933131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086008a-f3db-4cc5-b32c-dcd69808e23a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:55.977775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:55.978451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:55.978901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:55.979163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:55.979897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:55.980323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:55.981597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:55.990875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 180/353] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:22:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:55.991768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.027462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 174/354] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:56.028757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226055ef-69d6-4343-9b89-edb95f323257 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.030620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226055ef-69d6-4343-9b89-edb95f323257 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.030620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226055ef-69d6-4343-9b89-edb95f323257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.049969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-226055ef-69d6-4343-9b89-edb95f323257 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:56.051654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-226055ef-69d6-4343-9b89-edb95f323257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:56.090122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:56.113458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87ad7-7e99-4f89-ad9d-1f4a6de68e45 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:56.132487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 175/355] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:56.133899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226055ef-69d6-4343-9b89-edb95f323257 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.142806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:56.153864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9db94c-2997-4aa5-ac24-585249e69375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:56.154532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db94c-2997-4aa5-ac24-585249e69375 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.154818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db94c-2997-4aa5-ac24-585249e69375 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.155099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9db94c-2997-4aa5-ac24-585249e69375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.156022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9db94c-2997-4aa5-ac24-585249e69375 None admin] RBAC: Adding query filter params (group.id=882fb7dde4fe4c2f99911dd762c75eb4, role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=ad8175c8bdea405c88557743edcacad4) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:56.156342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9db94c-2997-4aa5-ac24-585249e69375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:56.159314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9db94c-2997-4aa5-ac24-585249e69375 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:56.165030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 181/356] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:22:55 2022] GET /identity/v3/role_assignments?group.id=882fb7dde4fe4c2f99911dd762c75eb4&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:56.166366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32c4d3-bc21-4b79-8514-65f1764460e2 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.166726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32c4d3-bc21-4b79-8514-65f1764460e2 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.167010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32c4d3-bc21-4b79-8514-65f1764460e2 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.168551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 182/357] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:22:56.169375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32c4d3-bc21-4b79-8514-65f1764460e2 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.283466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226055ef-69d6-4343-9b89-edb95f323257 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:56.322301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32c4d3-bc21-4b79-8514-65f1764460e2 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:56.334614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:56.334614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.334924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.335087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.336369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:56.336369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:56.337925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:56.349229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 176/358] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:56.350040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.369422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a5445-7d49-4cf8-8a6a-ddf7aaec0ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:56.370711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a5445-7d49-4cf8-8a6a-ddf7aaec0ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.371249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a5445-7d49-4cf8-8a6a-ddf7aaec0ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.371875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a5445-7d49-4cf8-8a6a-ddf7aaec0ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.392477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:56.434559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:56.465836 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a5445-7d49-4cf8-8a6a-ddf7aaec0ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:56.468264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a5445-7d49-4cf8-8a6a-ddf7aaec0ed0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:56.477438 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f05a8-0a61-414c-8109-c2cd0a24b5f3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:56.520492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669d18-cf3e-482d-8ca4-cd68e3b556aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:56.522667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d18-cf3e-482d-8ca4-cd68e3b556aa None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.522667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d18-cf3e-482d-8ca4-cd68e3b556aa None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.522667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d18-cf3e-482d-8ca4-cd68e3b556aa None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.525449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f669d18-cf3e-482d-8ca4-cd68e3b556aa None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:56.525876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f669d18-cf3e-482d-8ca4-cd68e3b556aa None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:56.528169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 177/359] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:56 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:56.529175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669d18-cf3e-482d-8ca4-cd68e3b556aa None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.595550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 183/360] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:56.597048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beca90f-3e76-48a9-8e1e-08c24a0a5a18 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.597337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beca90f-3e76-48a9-8e1e-08c24a0a5a18 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.597614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beca90f-3e76-48a9-8e1e-08c24a0a5a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.617691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7beca90f-3e76-48a9-8e1e-08c24a0a5a18 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:56.618806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7beca90f-3e76-48a9-8e1e-08c24a0a5a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:56.666271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669d18-cf3e-482d-8ca4-cd68e3b556aa None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:56.675820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:56.707720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 184/361] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:56.708374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beca90f-3e76-48a9-8e1e-08c24a0a5a18 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.709292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed65b1f-e414-4171-a108-1d0fc7f6238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:56.710117 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed65b1f-e414-4171-a108-1d0fc7f6238b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.710550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed65b1f-e414-4171-a108-1d0fc7f6238b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.710810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed65b1f-e414-4171-a108-1d0fc7f6238b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.722128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed65b1f-e414-4171-a108-1d0fc7f6238b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:56.727818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1ed65b1f-e414-4171-a108-1d0fc7f6238b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:56.732279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:56.733328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:56.735268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 178/362] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:22:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:56.735975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed65b1f-e414-4171-a108-1d0fc7f6238b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.844675 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beca90f-3e76-48a9-8e1e-08c24a0a5a18 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:56.873408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed65b1f-e414-4171-a108-1d0fc7f6238b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:56.895098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6e99-3c1c-4c5e-9e03-3b12906a02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:56.896953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6e99-3c1c-4c5e-9e03-3b12906a02e1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.896953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6e99-3c1c-4c5e-9e03-3b12906a02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.896953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6e99-3c1c-4c5e-9e03-3b12906a02e1 None admin] PATH_INFO: `/v3/users/5e22265bd7f944d18c23de76486ee604` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.899838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac6e99-3c1c-4c5e-9e03-3b12906a02e1 None admin] RBAC: Authorizing `identity:get_user(user_id=5e22265bd7f944d18c23de76486ee604)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:56.902021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac6e99-3c1c-4c5e-9e03-3b12906a02e1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:56.903211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 185/363] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:22:56 2022] GET /identity/v3/users/5e22265bd7f944d18c23de76486ee604 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:56.907932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6e99-3c1c-4c5e-9e03-3b12906a02e1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.926871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067c09-0406-42e8-b8a7-5e590d50865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:56.927740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067c09-0406-42e8-b8a7-5e590d50865f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:56.928023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067c09-0406-42e8-b8a7-5e590d50865f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:56.928390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067c09-0406-42e8-b8a7-5e590d50865f None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:56.931421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5067c09-0406-42e8-b8a7-5e590d50865f None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:56.935004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5067c09-0406-42e8-b8a7-5e590d50865f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:56.935004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 179/364] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:22:56 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:56.935327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067c09-0406-42e8-b8a7-5e590d50865f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:56.976089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:57.015553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:57.049942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6e99-3c1c-4c5e-9e03-3b12906a02e1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.068384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067c09-0406-42e8-b8a7-5e590d50865f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.087957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1e14-9a10-4e03-aedc-31e29b0cd229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.089036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1e14-9a10-4e03-aedc-31e29b0cd229 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.089393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1e14-9a10-4e03-aedc-31e29b0cd229 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.089745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1e14-9a10-4e03-aedc-31e29b0cd229 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.091043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e1e14-9a10-4e03-aedc-31e29b0cd229 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:57.092558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e1e14-9a10-4e03-aedc-31e29b0cd229 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:57.095104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 186/365] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:56 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:57.095952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1e14-9a10-4e03-aedc-31e29b0cd229 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:57.110523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.111549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.111911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.112262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.113124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:57.113502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:57.114885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:57.127058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 180/366] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:57.127852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:57.215000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1e14-9a10-4e03-aedc-31e29b0cd229 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.231833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:57.252273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbdf7b-5b2d-4577-b295-0d5c89a4e33f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.265746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8ebf3-68aa-4736-b71f-cc991b439f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.267204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8ebf3-68aa-4736-b71f-cc991b439f38 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.267583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8ebf3-68aa-4736-b71f-cc991b439f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.267963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8ebf3-68aa-4736-b71f-cc991b439f38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.280359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8ebf3-68aa-4736-b71f-cc991b439f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:57.286337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7cb8ebf3-68aa-4736-b71f-cc991b439f38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:57.288730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:57.289833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:22:57.290708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:22:57.291370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 187/367] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:22:57.295303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8ebf3-68aa-4736-b71f-cc991b439f38 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:57.304005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.304692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.305013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.305295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.306152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] RBAC: Adding query filter params (role.id=42ddc037011a4faf942409f6f034415c, user.id=5e22265bd7f944d18c23de76486ee604, scope.system=all) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:57.306471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:57.307982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:57.332857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 181/368] 10.222.0.79 () {56 vars in 1308 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/role_assignments?user.id=5e22265bd7f944d18c23de76486ee604&scope.system=all&role.id=42ddc037011a4faf942409f6f034415c => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:57.332857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:57.428070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8ebf3-68aa-4736-b71f-cc991b439f38 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.469800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.471059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.471495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.471782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.472933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] RBAC: Adding query filter params (group.id=882fb7dde4fe4c2f99911dd762c75eb4, role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=66a61523318545c98b246fc2d64ad948) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:57.473255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:57.475468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:57.476425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf217a3-98ab-44b9-a85f-4423ce186563 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.483712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 188/369] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/role_assignments?group.id=882fb7dde4fe4c2f99911dd762c75eb4&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:57.485367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:57.516631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8516a5-c7c4-4ba9-891b-cd2149f84e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.517724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8516a5-c7c4-4ba9-891b-cd2149f84e15 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.518083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8516a5-c7c4-4ba9-891b-cd2149f84e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.518445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8516a5-c7c4-4ba9-891b-cd2149f84e15 None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.521188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8516a5-c7c4-4ba9-891b-cd2149f84e15 None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:57.523463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8516a5-c7c4-4ba9-891b-cd2149f84e15 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:57.525702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 182/370] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:57.526707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8516a5-c7c4-4ba9-891b-cd2149f84e15 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:57.547491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:57.608411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:57.646277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34e2c-9e14-45bf-bdbc-606e539d11c0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.682069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8516a5-c7c4-4ba9-891b-cd2149f84e15 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.695863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238dcb-8150-4143-9c30-e81f29806d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.696945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238dcb-8150-4143-9c30-e81f29806d1d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.697236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238dcb-8150-4143-9c30-e81f29806d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.697864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238dcb-8150-4143-9c30-e81f29806d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.730259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.730930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.731240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.732028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.733101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:57.733422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:57.736042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:57.746972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 183/371] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:57.747584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:57.802039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd238dcb-8150-4143-9c30-e81f29806d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:57.803507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd238dcb-8150-4143-9c30-e81f29806d1d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:57.839126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:57.866270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0028-1068-4b86-a25e-5709b6c92ad2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:57.880964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:57.902215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:57.903257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:57.903755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:57.904233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:57.905307 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] RBAC: Adding query filter params (group.id=882fb7dde4fe4c2f99911dd762c75eb4, role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=ad8175c8bdea405c88557743edcacad4) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:57.905839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:57.908041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:57.910439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 189/372] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:57.911292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238dcb-8150-4143-9c30-e81f29806d1d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:57.916996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 184/373] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/role_assignments?group.id=882fb7dde4fe4c2f99911dd762c75eb4&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:57.918196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:58.026152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb336-b619-48cf-8b4e-e9f1d88cece7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:58.064858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9953-39f2-4680-9f04-5be4ee2cd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:58.067120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9953-39f2-4680-9f04-5be4ee2cd0cd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:58.067617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9953-39f2-4680-9f04-5be4ee2cd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:58.068095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9953-39f2-4680-9f04-5be4ee2cd0cd None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:58.069605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae9953-39f2-4680-9f04-5be4ee2cd0cd None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:58.071351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae9953-39f2-4680-9f04-5be4ee2cd0cd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:58.071755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238dcb-8150-4143-9c30-e81f29806d1d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:58.073975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 185/374] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:58.080007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9953-39f2-4680-9f04-5be4ee2cd0cd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:58.150947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d099c03-7f36-4589-9094-33ef7436485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:58.151635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d099c03-7f36-4589-9094-33ef7436485a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:58.151901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d099c03-7f36-4589-9094-33ef7436485a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:58.152180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d099c03-7f36-4589-9094-33ef7436485a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:58.160020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:58.169628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:58.222994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9953-39f2-4680-9f04-5be4ee2cd0cd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:58.263856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5bb9-7622-47c1-b263-3da4ea9bc2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:58.265535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5bb9-7622-47c1-b263-3da4ea9bc2ab None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:58.266054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5bb9-7622-47c1-b263-3da4ea9bc2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:58.266544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5bb9-7622-47c1-b263-3da4ea9bc2ab None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:58.267945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5bb9-7622-47c1-b263-3da4ea9bc2ab None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:58.269606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5bb9-7622-47c1-b263-3da4ea9bc2ab None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:58.271804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 186/375] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:22:58 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:58.277208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5bb9-7622-47c1-b263-3da4ea9bc2ab None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:58.283467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d099c03-7f36-4589-9094-33ef7436485a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:58.284986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d099c03-7f36-4589-9094-33ef7436485a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:58.394674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5bb9-7622-47c1-b263-3da4ea9bc2ab None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:58.412036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:58.435026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:58.435692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:58.435976 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:58.436359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:58.437346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] RBAC: Adding query filter params (group.id=882fb7dde4fe4c2f99911dd762c75eb4, role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=66a61523318545c98b246fc2d64ad948) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:58.437853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:58.439455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:58.446776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 187/376] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:22:58 2022] GET /identity/v3/role_assignments?group.id=882fb7dde4fe4c2f99911dd762c75eb4&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:58.470696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 190/377] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:22:58.476901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:58.569909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e97a9-f416-4484-8a7c-da16ad1632ca None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:58.570189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e97a9-f416-4484-8a7c-da16ad1632ca None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:58.570654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e97a9-f416-4484-8a7c-da16ad1632ca None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:58.572471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 191/378] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:22:58.581669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ff87f-c916-44ba-88fa-dea318148116 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:58.582189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ff87f-c916-44ba-88fa-dea318148116 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:58.582606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ff87f-c916-44ba-88fa-dea318148116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:58.610897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-502ff87f-c916-44ba-88fa-dea318148116 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:22:58.612139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-502ff87f-c916-44ba-88fa-dea318148116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:22:58.666597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:58.670942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd35b88-5614-428f-b1d3-a106be959678 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:58.715044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dc9d0-9ead-4e94-b542-12abe09eba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:58.716229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dc9d0-9ead-4e94-b542-12abe09eba60 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:58.716349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 192/379] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:22:58.716771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dc9d0-9ead-4e94-b542-12abe09eba60 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:58.717151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dc9d0-9ead-4e94-b542-12abe09eba60 None admin] PATH_INFO: `/v3/projects/8f1d06ca36e140b391bdeae31455b36e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:58.719758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dc9d0-9ead-4e94-b542-12abe09eba60 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1d06ca36e140b391bdeae31455b36e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:58.722201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dc9d0-9ead-4e94-b542-12abe09eba60 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:58.728854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 188/380] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:58 2022] GET /identity/v3/projects/8f1d06ca36e140b391bdeae31455b36e => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:58.729002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ff87f-c916-44ba-88fa-dea318148116 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:58.754411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dc9d0-9ead-4e94-b542-12abe09eba60 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:58.836275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ff87f-c916-44ba-88fa-dea318148116 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:58.874278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7edfe4-8e57-4f8e-ba76-1252b48557b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:58.875542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7edfe4-8e57-4f8e-ba76-1252b48557b4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:58.876030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7edfe4-8e57-4f8e-ba76-1252b48557b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:58.876510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7edfe4-8e57-4f8e-ba76-1252b48557b4 None admin] PATH_INFO: `/v3/groups/b20bca8dd5f2415291f8fac1ed209b1b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:58.884046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7edfe4-8e57-4f8e-ba76-1252b48557b4 None admin] RBAC: Authorizing `identity:get_group(group_id=b20bca8dd5f2415291f8fac1ed209b1b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:58.885818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7edfe4-8e57-4f8e-ba76-1252b48557b4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:58.888028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 193/381] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:22:58 2022] GET /identity/v3/groups/b20bca8dd5f2415291f8fac1ed209b1b => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:58.895042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7edfe4-8e57-4f8e-ba76-1252b48557b4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:58.910273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:58.961267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:59.025130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7edfe4-8e57-4f8e-ba76-1252b48557b4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:59.031370 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dc9d0-9ead-4e94-b542-12abe09eba60 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:59.075056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72eddf-e53d-485a-94c4-3ced609839f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:59.076408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72eddf-e53d-485a-94c4-3ced609839f9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:59.076961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72eddf-e53d-485a-94c4-3ced609839f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:59.077442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72eddf-e53d-485a-94c4-3ced609839f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:59.091150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72eddf-e53d-485a-94c4-3ced609839f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8a72eddf-e53d-485a-94c4-3ced609839f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:22:59.100186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:22:59.101154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:22:59.102044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:22:59.105179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 189/382] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:22:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:22:59.111276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72eddf-e53d-485a-94c4-3ced609839f9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:59.130486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:59.131692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:59.133072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:59.134318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:59.135404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] RBAC: Adding query filter params (group.id=b20bca8dd5f2415291f8fac1ed209b1b, role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=8f1d06ca36e140b391bdeae31455b36e) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:59.136134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:59.138897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:59.155665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 194/383] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:22:58 2022] GET /identity/v3/role_assignments?group.id=b20bca8dd5f2415291f8fac1ed209b1b&scope.project.id=8f1d06ca36e140b391bdeae31455b36e&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:22:59.268228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72eddf-e53d-485a-94c4-3ced609839f9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:59.275579 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:59.316013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:59.316697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:59.317018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:59.317294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:59.318050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:22:59.318351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:59.319752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:59.334387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 190/384] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:22:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:59.340193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:59.468944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:22:59.476620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fda7b0-97fd-4cc7-b45b-a0555aca4597 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:59.513770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08176baf-e3d1-4296-9358-a48977c9c17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:59.514962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176baf-e3d1-4296-9358-a48977c9c17d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:59.515482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176baf-e3d1-4296-9358-a48977c9c17d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:59.516009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176baf-e3d1-4296-9358-a48977c9c17d None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:59.521623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08176baf-e3d1-4296-9358-a48977c9c17d None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:59.523313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08176baf-e3d1-4296-9358-a48977c9c17d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:59.525269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 195/385] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:22:59 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:59.533915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:59.671340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af508f5-fd2b-4cf3-b7f0-64c76b96838e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:59.705862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372e17a-d563-4866-b87e-e1a6a70ebd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:59.706984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e17a-d563-4866-b87e-e1a6a70ebd21 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:59.707420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e17a-d563-4866-b87e-e1a6a70ebd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:59.707839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e17a-d563-4866-b87e-e1a6a70ebd21 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:59.709194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372e17a-d563-4866-b87e-e1a6a70ebd21 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:59.710806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372e17a-d563-4866-b87e-e1a6a70ebd21 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:59.716923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 191/386] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:22:59 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:22:59.719266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08176baf-e3d1-4296-9358-a48977c9c17d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:22:59.834446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08176baf-e3d1-4296-9358-a48977c9c17d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:22:59.882746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ea9e5-ccc1-40eb-90a2-9a8668349115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:22:59.883903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea9e5-ccc1-40eb-90a2-9a8668349115 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:22:59.884329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea9e5-ccc1-40eb-90a2-9a8668349115 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:22:59.884750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea9e5-ccc1-40eb-90a2-9a8668349115 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4/groups/882fb7dde4fe4c2f99911dd762c75eb4/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:22:59.886895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ea9e5-ccc1-40eb-90a2-9a8668349115 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad8175c8bdea405c88557743edcacad4, group_id=882fb7dde4fe4c2f99911dd762c75eb4, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:22:59.888494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ea9e5-ccc1-40eb-90a2-9a8668349115 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:22:59.910653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 196/387] 10.222.0.79 () {58 vars in 1442 bytes} [Fri May 27 09:22:59 2022] PUT /identity/v3/projects/ad8175c8bdea405c88557743edcacad4/groups/882fb7dde4fe4c2f99911dd762c75eb4/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:00.409483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bfdc-df44-4f3d-a2fd-edd21b76ee40 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:00.410328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bfdc-df44-4f3d-a2fd-edd21b76ee40 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:00.410786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bfdc-df44-4f3d-a2fd-edd21b76ee40 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:00.412587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 192/388] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:00.417469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294c103-3b8e-432f-a5ec-a4ab71dd3d2c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:00.418209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294c103-3b8e-432f-a5ec-a4ab71dd3d2c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:00.418634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294c103-3b8e-432f-a5ec-a4ab71dd3d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:00.442460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9294c103-3b8e-432f-a5ec-a4ab71dd3d2c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:00.443980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9294c103-3b8e-432f-a5ec-a4ab71dd3d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:00.468233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:00.539628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 197/389] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:00.575168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bfdc-df44-4f3d-a2fd-edd21b76ee40 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:00.621580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:00.677511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b55-be3d-4ba8-b62e-c6dc95b1116a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:00.678133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b55-be3d-4ba8-b62e-c6dc95b1116a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:00.678611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b55-be3d-4ba8-b62e-c6dc95b1116a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:00.684153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 198/390] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:00.685976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b54e-47aa-43c4-a84c-62605d52308f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:00.686472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b54e-47aa-43c4-a84c-62605d52308f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:00.686977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b54e-47aa-43c4-a84c-62605d52308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:00.694504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bfdc-df44-4f3d-a2fd-edd21b76ee40 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:00.709354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e656b54e-47aa-43c4-a84c-62605d52308f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:00.711057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e656b54e-47aa-43c4-a84c-62605d52308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:00.751074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1039-45c2-43a2-9f42-f6171654fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:00.751878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1039-45c2-43a2-9f42-f6171654fa5b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:00.752165 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1039-45c2-43a2-9f42-f6171654fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:00.752443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1039-45c2-43a2-9f42-f6171654fa5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:00.767260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff1039-45c2-43a2-9f42-f6171654fa5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c9ff1039-45c2-43a2-9f42-f6171654fa5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:00.775970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:00.776890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:00.777717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 193/391] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:00.785627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1039-45c2-43a2-9f42-f6171654fa5b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:00.826573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 199/392] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:00.866305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b54e-47aa-43c4-a84c-62605d52308f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:00.959934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:00.982120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b54e-47aa-43c4-a84c-62605d52308f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:00.982786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:00.995099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1039-45c2-43a2-9f42-f6171654fa5b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:01.023931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f38f5-4cf4-4227-aae8-eca3fea039a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.025117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f38f5-4cf4-4227-aae8-eca3fea039a6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.025599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f38f5-4cf4-4227-aae8-eca3fea039a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.026055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f38f5-4cf4-4227-aae8-eca3fea039a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.038470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f38f5-4cf4-4227-aae8-eca3fea039a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-020f38f5-4cf4-4227-aae8-eca3fea039a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:01.048482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:01.049446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:01.050250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:01.052701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 200/393] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:01.059148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f38f5-4cf4-4227-aae8-eca3fea039a6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:01.086387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.087603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.088056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.088481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.091741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:01.092249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:01.093864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:01.112246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 194/394] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:01.117770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:01.251457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f38f5-4cf4-4227-aae8-eca3fea039a6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:01.288510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.289456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.289914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.290339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.291292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:01.291749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:01.293409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:01.304020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 201/395] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:01.311293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:01.329201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:01.426644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf7681-8995-463e-a4cb-566e06c95a6b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:01.430808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f92a5-b255-4852-99a1-0a1ada87e765 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:01.474134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a2e85-fad2-4500-99b8-84bf25e5061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.475532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2e85-fad2-4500-99b8-84bf25e5061b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.476046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2e85-fad2-4500-99b8-84bf25e5061b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.476601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2e85-fad2-4500-99b8-84bf25e5061b None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.476850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c42746-3716-4de3-aa82-b3a66e47b60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.477718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42746-3716-4de3-aa82-b3a66e47b60d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.478001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42746-3716-4de3-aa82-b3a66e47b60d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.478281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42746-3716-4de3-aa82-b3a66e47b60d None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.479038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a2e85-fad2-4500-99b8-84bf25e5061b None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:01.479457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c42746-3716-4de3-aa82-b3a66e47b60d None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:01.480921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c42746-3716-4de3-aa82-b3a66e47b60d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:01.481216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a2e85-fad2-4500-99b8-84bf25e5061b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:01.483305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 202/397] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:01 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:01.485490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfa55c-1820-4ca0-8bc1-0bad0d7516f0 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.485989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfa55c-1820-4ca0-8bc1-0bad0d7516f0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.486488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfa55c-1820-4ca0-8bc1-0bad0d7516f0 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.488046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 203/398] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:01.488905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 195/398] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:01 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:01.493478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfa55c-1820-4ca0-8bc1-0bad0d7516f0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:01.493793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c42746-3716-4de3-aa82-b3a66e47b60d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:01.525705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:01.597394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:01.618353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c42746-3716-4de3-aa82-b3a66e47b60d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:01.640442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfa55c-1820-4ca0-8bc1-0bad0d7516f0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:01.653181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7d660-907a-4771-8f01-74acdf078476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.654308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d660-907a-4771-8f01-74acdf078476 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.654814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d660-907a-4771-8f01-74acdf078476 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.655286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7d660-907a-4771-8f01-74acdf078476 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.657328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7d660-907a-4771-8f01-74acdf078476 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:01.658983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7d660-907a-4771-8f01-74acdf078476 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:01.660966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 196/399] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:01 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:01.666351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43b05d-1164-4e5f-ae3e-c6a40620d3cb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.666849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43b05d-1164-4e5f-ae3e-c6a40620d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.667328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43b05d-1164-4e5f-ae3e-c6a40620d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.682544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89639c6b-e818-4362-9536-d3602d5f1a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.683337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639c6b-e818-4362-9536-d3602d5f1a39 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.683627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639c6b-e818-4362-9536-d3602d5f1a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.683909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639c6b-e818-4362-9536-d3602d5f1a39 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.685141 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89639c6b-e818-4362-9536-d3602d5f1a39 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:01.686693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89639c6b-e818-4362-9536-d3602d5f1a39 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:01.687041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fa43b05d-1164-4e5f-ae3e-c6a40620d3cb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:01.689638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fa43b05d-1164-4e5f-ae3e-c6a40620d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:01.689764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 204/400] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:01 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:01.689764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89639c6b-e818-4362-9536-d3602d5f1a39 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:01.764525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 197/401] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:01.765803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43b05d-1164-4e5f-ae3e-c6a40620d3cb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:01.791137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:01.803724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89639c6b-e818-4362-9536-d3602d5f1a39 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:01.839394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2e773-d69e-41fa-a050-9b2a312228bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.840280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e773-d69e-41fa-a050-9b2a312228bc None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.840561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e773-d69e-41fa-a050-9b2a312228bc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.840853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e773-d69e-41fa-a050-9b2a312228bc None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948/groups/882fb7dde4fe4c2f99911dd762c75eb4/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.842823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2e773-d69e-41fa-a050-9b2a312228bc None admin] RBAC: Authorizing `identity:create_grant(project_id=66a61523318545c98b246fc2d64ad948, group_id=882fb7dde4fe4c2f99911dd762c75eb4, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:01.844798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2e773-d69e-41fa-a050-9b2a312228bc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:01.854689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:01.859782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 205/402] 10.222.0.79 () {58 vars in 1442 bytes} [Fri May 27 09:23:01 2022] PUT /identity/v3/projects/66a61523318545c98b246fc2d64ad948/groups/882fb7dde4fe4c2f99911dd762c75eb4/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:01.861438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ccfb-ca77-4637-85a7-c452ce3ac683 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.862250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ccfb-ca77-4637-85a7-c452ce3ac683 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.862623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ccfb-ca77-4637-85a7-c452ce3ac683 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.869026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 206/403] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:01.871449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608ccfb-ca77-4637-85a7-c452ce3ac683 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:01.884333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43b05d-1164-4e5f-ae3e-c6a40620d3cb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:01.934056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863a5ea-7606-45d2-893a-f1d10860bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:01.935349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a5ea-7606-45d2-893a-f1d10860bd13 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.935850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a5ea-7606-45d2-893a-f1d10860bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.936369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a5ea-7606-45d2-893a-f1d10860bd13 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4/groups/882fb7dde4fe4c2f99911dd762c75eb4/roles/5a932a8a65dd4faab8c58bcf29388fc7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.939113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863a5ea-7606-45d2-893a-f1d10860bd13 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad8175c8bdea405c88557743edcacad4, group_id=882fb7dde4fe4c2f99911dd762c75eb4, role_id=5a932a8a65dd4faab8c58bcf29388fc7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:01.940905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863a5ea-7606-45d2-893a-f1d10860bd13 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:01.963810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 198/404] 10.222.0.79 () {58 vars in 1442 bytes} [Fri May 27 09:23:01 2022] PUT /identity/v3/projects/ad8175c8bdea405c88557743edcacad4/groups/882fb7dde4fe4c2f99911dd762c75eb4/roles/5a932a8a65dd4faab8c58bcf29388fc7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:01.965859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a6ec-1979-4bff-bae8-abf38f9547be None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:01.966814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a6ec-1979-4bff-bae8-abf38f9547be None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:01.967282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a6ec-1979-4bff-bae8-abf38f9547be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:01.990754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3b18a6ec-1979-4bff-bae8-abf38f9547be None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:01.993029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3b18a6ec-1979-4bff-bae8-abf38f9547be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:02.018344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608ccfb-ca77-4637-85a7-c452ce3ac683 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:02.059344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1541e-7193-4c5e-81ee-a490fe723ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:02.060404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1541e-7193-4c5e-81ee-a490fe723ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.060757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1541e-7193-4c5e-81ee-a490fe723ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.061159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1541e-7193-4c5e-81ee-a490fe723ec2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.076541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1541e-7193-4c5e-81ee-a490fe723ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-23d1541e-7193-4c5e-81ee-a490fe723ec2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:02.086670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:02.088090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:02.089118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:02.091482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 207/405] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:02.093631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 199/406] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:02.100948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1541e-7193-4c5e-81ee-a490fe723ec2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:02.120102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18a6ec-1979-4bff-bae8-abf38f9547be None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:02.137233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:02.186911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:02.255035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1541e-7193-4c5e-81ee-a490fe723ec2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:02.264477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18a6ec-1979-4bff-bae8-abf38f9547be None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:02.305376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:02.306039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.306319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.306594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.307343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:02.307647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:02.309355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:02.314837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ae65-70fc-4d09-8866-18598678d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:02.316468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ae65-70fc-4d09-8866-18598678d301 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.317257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ae65-70fc-4d09-8866-18598678d301 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.317734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ae65-70fc-4d09-8866-18598678d301 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.319444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 208/407] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:02.326460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:02.334043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67ae65-70fc-4d09-8866-18598678d301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ca67ae65-70fc-4d09-8866-18598678d301 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:02.342371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:02.343262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:02.344611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:02.347338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 200/408] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:02.356621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ae65-70fc-4d09-8866-18598678d301 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:02.448017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df30f0-9b82-449c-83e0-aa315eb8c17c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:02.474545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:02.498193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689ff68-5388-49ad-bd48-f8c7abd44ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:02.500246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ff68-5388-49ad-bd48-f8c7abd44ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.500246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ff68-5388-49ad-bd48-f8c7abd44ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.500246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ff68-5388-49ad-bd48-f8c7abd44ce4 None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.504533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689ff68-5388-49ad-bd48-f8c7abd44ce4 None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:02.506030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689ff68-5388-49ad-bd48-f8c7abd44ce4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:02.513195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 209/409] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:02 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:02.514064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689ff68-5388-49ad-bd48-f8c7abd44ce4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:02.569837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:02.598447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ae65-70fc-4d09-8866-18598678d301 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:02.648886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a190d-0d6f-496d-afd0-9beffbc848fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:02.650229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a190d-0d6f-496d-afd0-9beffbc848fc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.650748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a190d-0d6f-496d-afd0-9beffbc848fc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.651360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a190d-0d6f-496d-afd0-9beffbc848fc None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.652960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a190d-0d6f-496d-afd0-9beffbc848fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:02.653482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a190d-0d6f-496d-afd0-9beffbc848fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:02.655807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a190d-0d6f-496d-afd0-9beffbc848fc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:02.661773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689ff68-5388-49ad-bd48-f8c7abd44ce4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:02.667654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 201/410] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:02.669243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340be39-340f-43f3-a92d-052e6609184d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.669805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340be39-340f-43f3-a92d-052e6609184d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.670308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340be39-340f-43f3-a92d-052e6609184d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.676578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 202/411] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:02.677624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340be39-340f-43f3-a92d-052e6609184d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:02.710676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa9732-27d2-44f6-be67-b054f5d3d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:02.711736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9732-27d2-44f6-be67-b054f5d3d54e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.712297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9732-27d2-44f6-be67-b054f5d3d54e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.712579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9732-27d2-44f6-be67-b054f5d3d54e None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.714070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa9732-27d2-44f6-be67-b054f5d3d54e None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:02.716205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa9732-27d2-44f6-be67-b054f5d3d54e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:02.718648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 210/412] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:02 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:02.725151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec96871-d48d-498a-ae5a-fdd5d885b724 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.725445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec96871-d48d-498a-ae5a-fdd5d885b724 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.725724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec96871-d48d-498a-ae5a-fdd5d885b724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.746279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6ec96871-d48d-498a-ae5a-fdd5d885b724 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:02.747858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6ec96871-d48d-498a-ae5a-fdd5d885b724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:02.812241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340be39-340f-43f3-a92d-052e6609184d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:02.817770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:02.842504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 211/413] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:02.842504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec96871-d48d-498a-ae5a-fdd5d885b724 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:02.868669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ba644-77ac-4f05-9745-a06ffa2e3b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:02.870207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba644-77ac-4f05-9745-a06ffa2e3b0c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:02.870804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba644-77ac-4f05-9745-a06ffa2e3b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:02.871286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba644-77ac-4f05-9745-a06ffa2e3b0c None admin] PATH_INFO: `/v3/groups/b20bca8dd5f2415291f8fac1ed209b1b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:02.873191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ba644-77ac-4f05-9745-a06ffa2e3b0c None admin] RBAC: Authorizing `identity:get_group(group_id=b20bca8dd5f2415291f8fac1ed209b1b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:02.875812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ba644-77ac-4f05-9745-a06ffa2e3b0c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:02.878877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 203/414] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:02 2022] GET /identity/v3/groups/b20bca8dd5f2415291f8fac1ed209b1b => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:02.879921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ba644-77ac-4f05-9745-a06ffa2e3b0c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:02.883922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:02.965009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec96871-d48d-498a-ae5a-fdd5d885b724 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:03.002620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355cbf9-dc43-4ceb-8b9d-f6c64bf77f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:03.003823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cbf9-dc43-4ceb-8b9d-f6c64bf77f87 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:03.004417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cbf9-dc43-4ceb-8b9d-f6c64bf77f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:03.005144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cbf9-dc43-4ceb-8b9d-f6c64bf77f87 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948/groups/882fb7dde4fe4c2f99911dd762c75eb4/roles/5a932a8a65dd4faab8c58bcf29388fc7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:03.007766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355cbf9-dc43-4ceb-8b9d-f6c64bf77f87 None admin] RBAC: Authorizing `identity:create_grant(project_id=66a61523318545c98b246fc2d64ad948, group_id=882fb7dde4fe4c2f99911dd762c75eb4, role_id=5a932a8a65dd4faab8c58bcf29388fc7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:03.009584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355cbf9-dc43-4ceb-8b9d-f6c64bf77f87 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:03.010717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ba644-77ac-4f05-9745-a06ffa2e3b0c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:03.032864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 212/415] 10.222.0.79 () {58 vars in 1442 bytes} [Fri May 27 09:23:02 2022] PUT /identity/v3/projects/66a61523318545c98b246fc2d64ad948/groups/882fb7dde4fe4c2f99911dd762c75eb4/roles/5a932a8a65dd4faab8c58bcf29388fc7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:03.034548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355cbf9-dc43-4ceb-8b9d-f6c64bf77f87 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:03.077598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6297149-c6c3-47b9-af17-f3660eb0021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:03.079093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6297149-c6c3-47b9-af17-f3660eb0021d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:03.079467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6297149-c6c3-47b9-af17-f3660eb0021d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:03.079750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6297149-c6c3-47b9-af17-f3660eb0021d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:03.099564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:03.106605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6297149-c6c3-47b9-af17-f3660eb0021d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d6297149-c6c3-47b9-af17-f3660eb0021d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:03.122942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:03.123951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:03.124763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 204/416] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:03.131220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6297149-c6c3-47b9-af17-f3660eb0021d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:03.165545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355cbf9-dc43-4ceb-8b9d-f6c64bf77f87 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:03.206631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2532800-410b-407f-93eb-a4e2a05db9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:03.208228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532800-410b-407f-93eb-a4e2a05db9bf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:03.208769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532800-410b-407f-93eb-a4e2a05db9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:03.209322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2532800-410b-407f-93eb-a4e2a05db9bf None admin] PATH_INFO: `/v3/projects/8f1d06ca36e140b391bdeae31455b36e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:03.210957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2532800-410b-407f-93eb-a4e2a05db9bf None admin] RBAC: Authorizing `identity:get_project(project_id=8f1d06ca36e140b391bdeae31455b36e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:03.211717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:03.214602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2532800-410b-407f-93eb-a4e2a05db9bf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:03.222158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 213/417] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:03 2022] GET /identity/v3/projects/8f1d06ca36e140b391bdeae31455b36e => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:03.224419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2532800-410b-407f-93eb-a4e2a05db9bf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:03.276319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6297149-c6c3-47b9-af17-f3660eb0021d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:03.314006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:03.314689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:03.314975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:03.315246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:03.316006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:03.316314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:03.317759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:03.327039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 205/418] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:23:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:03.332448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:03.357154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2532800-410b-407f-93eb-a4e2a05db9bf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:03.376734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:03.400230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710e8a4-834d-4838-ac9a-aca67f7d7887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:03.401725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e8a4-834d-4838-ac9a-aca67f7d7887 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:03.402427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e8a4-834d-4838-ac9a-aca67f7d7887 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:03.402911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e8a4-834d-4838-ac9a-aca67f7d7887 None admin] PATH_INFO: `/v3/projects/8f1d06ca36e140b391bdeae31455b36e/groups/b20bca8dd5f2415291f8fac1ed209b1b/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:03.405308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710e8a4-834d-4838-ac9a-aca67f7d7887 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1d06ca36e140b391bdeae31455b36e, group_id=b20bca8dd5f2415291f8fac1ed209b1b, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:03.407816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710e8a4-834d-4838-ac9a-aca67f7d7887 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:03.426331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 214/419] 10.222.0.79 () {58 vars in 1442 bytes} [Fri May 27 09:23:03 2022] PUT /identity/v3/projects/8f1d06ca36e140b391bdeae31455b36e/groups/b20bca8dd5f2415291f8fac1ed209b1b/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:23:03.451243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf91316-96ea-40f3-98c9-bfea8bfe78a7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:03.482781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:03.493305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04db27-a2f6-4358-ad5a-3a8483395f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:03.494037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db27-a2f6-4358-ad5a-3a8483395f62 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:03.494326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db27-a2f6-4358-ad5a-3a8483395f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:03.494610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db27-a2f6-4358-ad5a-3a8483395f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:03.574431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04db27-a2f6-4358-ad5a-3a8483395f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:03.576203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04db27-a2f6-4358-ad5a-3a8483395f62 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:03.689127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 206/420] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:23:03.691157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710e8a4-834d-4838-ac9a-aca67f7d7887 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:03.797391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710e8a4-834d-4838-ac9a-aca67f7d7887 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:03.845581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c61a1-e0db-4c1a-99d0-b07eb617b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:03.846453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c61a1-e0db-4c1a-99d0-b07eb617b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:03.846736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c61a1-e0db-4c1a-99d0-b07eb617b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:03.847015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c61a1-e0db-4c1a-99d0-b07eb617b2f2 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:03.850023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c61a1-e0db-4c1a-99d0-b07eb617b2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:03.851563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c61a1-e0db-4c1a-99d0-b07eb617b2f2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:03.853547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 215/421] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:03 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:03.858829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04db27-a2f6-4358-ad5a-3a8483395f62 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:03.893845 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:03.971096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04db27-a2f6-4358-ad5a-3a8483395f62 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:04.007788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4b498-5830-4406-a897-17a550ec806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:04.008657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4b498-5830-4406-a897-17a550ec806d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:04.008975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4b498-5830-4406-a897-17a550ec806d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:04.009258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4b498-5830-4406-a897-17a550ec806d None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:04.010461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4b498-5830-4406-a897-17a550ec806d None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:04.011903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4b498-5830-4406-a897-17a550ec806d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:04.013867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 207/422] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:03 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:04.019746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c61a1-e0db-4c1a-99d0-b07eb617b2f2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:04.079369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:04.139135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c61a1-e0db-4c1a-99d0-b07eb617b2f2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:04.175678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3415ca4-fa3e-47e5-b4c7-c36cb5866b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:04.176347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3415ca4-fa3e-47e5-b4c7-c36cb5866b60 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:04.176634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3415ca4-fa3e-47e5-b4c7-c36cb5866b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:04.176940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3415ca4-fa3e-47e5-b4c7-c36cb5866b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:04.177775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3415ca4-fa3e-47e5-b4c7-c36cb5866b60 None admin] RBAC: Adding query filter params (group.id=882fb7dde4fe4c2f99911dd762c75eb4, role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=ad8175c8bdea405c88557743edcacad4) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:04.178089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3415ca4-fa3e-47e5-b4c7-c36cb5866b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:04.179630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3415ca4-fa3e-47e5-b4c7-c36cb5866b60 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:04.186299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 216/423] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:23:04 2022] GET /identity/v3/role_assignments?group.id=882fb7dde4fe4c2f99911dd762c75eb4&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:04.529656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56f84-6f5a-45d8-9817-5309746626b4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:04.529994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56f84-6f5a-45d8-9817-5309746626b4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:04.530116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56f84-6f5a-45d8-9817-5309746626b4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:04.532293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 208/424] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:04.537348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3280349-6ac0-40be-9abd-a6da61c42093 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:04.537639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3280349-6ac0-40be-9abd-a6da61c42093 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:04.537920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3280349-6ac0-40be-9abd-a6da61c42093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:04.556584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c3280349-6ac0-40be-9abd-a6da61c42093 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:04.557820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c3280349-6ac0-40be-9abd-a6da61c42093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:04.644502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 217/425] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:04.667306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e56f84-6f5a-45d8-9817-5309746626b4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:04.773187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:04.777767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e56f84-6f5a-45d8-9817-5309746626b4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:04.814138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5fd1-2030-4d5d-a987-994c73d69cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:04.814938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5fd1-2030-4d5d-a987-994c73d69cdc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:04.815223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5fd1-2030-4d5d-a987-994c73d69cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:04.815500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5fd1-2030-4d5d-a987-994c73d69cdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:04.826031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5fd1-2030-4d5d-a987-994c73d69cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ca7e5fd1-2030-4d5d-a987-994c73d69cdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:04.833642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:04.834546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:23:04.835347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:04.839831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 209/426] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:04.841234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3280349-6ac0-40be-9abd-a6da61c42093 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:04.850842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d3e3-c7d5-492f-a49a-cc1afb0956e4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:04.851439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d3e3-c7d5-492f-a49a-cc1afb0956e4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:04.851925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d3e3-c7d5-492f-a49a-cc1afb0956e4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:04.854029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 210/427] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:04.859190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ce5a-9a36-4cba-bbeb-c08755b4e637 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:04.860232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ce5a-9a36-4cba-bbeb-c08755b4e637 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:04.860719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7ce5a-9a36-4cba-bbeb-c08755b4e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:04.880734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e2a7ce5a-9a36-4cba-bbeb-c08755b4e637 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:04.882544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e2a7ce5a-9a36-4cba-bbeb-c08755b4e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:04.895467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:04.966941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 211/428] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:04.973341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3280349-6ac0-40be-9abd-a6da61c42093 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:04.994965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7ce5a-9a36-4cba-bbeb-c08755b4e637 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.014693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.016166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.016658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.017143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.018545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] RBAC: Adding query filter params (name=member) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:05.019033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:05.021030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:05.037555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 218/429] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:23:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:05.040906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.099967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:05.120001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7ce5a-9a36-4cba-bbeb-c08755b4e637 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:05.163077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:05.163905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4861aa4-0dcf-48ae-ad4d-512fa65bf672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.164767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861aa4-0dcf-48ae-ad4d-512fa65bf672 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.165159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861aa4-0dcf-48ae-ad4d-512fa65bf672 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.165686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4861aa4-0dcf-48ae-ad4d-512fa65bf672 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.167622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57dcbe-2c38-48b9-8c52-0212886c1edc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:05.180570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4861aa4-0dcf-48ae-ad4d-512fa65bf672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d4861aa4-0dcf-48ae-ad4d-512fa65bf672 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:05.191032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:05.191947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:05.193106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 212/430] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:05.198720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4861aa4-0dcf-48ae-ad4d-512fa65bf672 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.209835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784603dd-ed0b-40c2-b4b3-3bec4f00bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.211155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784603dd-ed0b-40c2-b4b3-3bec4f00bc45 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.211604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784603dd-ed0b-40c2-b4b3-3bec4f00bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.212308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784603dd-ed0b-40c2-b4b3-3bec4f00bc45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.303237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784603dd-ed0b-40c2-b4b3-3bec4f00bc45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:05.305233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784603dd-ed0b-40c2-b4b3-3bec4f00bc45 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:05.325409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4861aa4-0dcf-48ae-ad4d-512fa65bf672 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:05.364634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.364815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.365231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.365582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.367999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:05.367999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:05.369619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:05.384507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 213/431] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:05.389852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.402325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:05.437811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:05.447740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 219/432] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:05.449163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784603dd-ed0b-40c2-b4b3-3bec4f00bc45 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.536543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58337-b594-4eee-bb0a-0d3ae8fc739a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:05.554763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784603dd-ed0b-40c2-b4b3-3bec4f00bc45 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:05.584090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a6899-44e3-45ae-8220-851c72b48391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.585149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a6899-44e3-45ae-8220-851c72b48391 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.585443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a6899-44e3-45ae-8220-851c72b48391 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.585721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a6899-44e3-45ae-8220-851c72b48391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.592436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34e7a-9ff7-420b-a609-d596f4c62438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.593331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34e7a-9ff7-420b-a609-d596f4c62438 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.593612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34e7a-9ff7-420b-a609-d596f4c62438 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.593951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34e7a-9ff7-420b-a609-d596f4c62438 None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.595676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c34e7a-9ff7-420b-a609-d596f4c62438 None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:05.597171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c34e7a-9ff7-420b-a609-d596f4c62438 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:05.603392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 220/433] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:05 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:05.604660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34e7a-9ff7-420b-a609-d596f4c62438 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.676538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a6899-44e3-45ae-8220-851c72b48391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:05.677983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a6899-44e3-45ae-8220-851c72b48391 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:05.687577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:05.694955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:05.746197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34e7a-9ff7-420b-a609-d596f4c62438 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:05.787897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f94cc7-0992-4162-9f87-0a695d9197e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.788764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f94cc7-0992-4162-9f87-0a695d9197e1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.789069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f94cc7-0992-4162-9f87-0a695d9197e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.789353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f94cc7-0992-4162-9f87-0a695d9197e1 None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.790532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f94cc7-0992-4162-9f87-0a695d9197e1 None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:05.791986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f94cc7-0992-4162-9f87-0a695d9197e1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:05.797172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 214/435] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:23:05.798610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 221/435] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:05 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:05.798929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a6899-44e3-45ae-8220-851c72b48391 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.799852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f94cc7-0992-4162-9f87-0a695d9197e1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.910391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f94cc7-0992-4162-9f87-0a695d9197e1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:05.911439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a6899-44e3-45ae-8220-851c72b48391 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:05.919718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:05.947047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780d0b-4cf2-453d-93dd-09704a8e5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.947839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780d0b-4cf2-453d-93dd-09704a8e5516 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.948200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780d0b-4cf2-453d-93dd-09704a8e5516 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.948416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780d0b-4cf2-453d-93dd-09704a8e5516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.949378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780d0b-4cf2-453d-93dd-09704a8e5516 None admin] RBAC: Adding query filter params (group.id=882fb7dde4fe4c2f99911dd762c75eb4, role.id=eb3e1f4520ed4e8f873819a4830e3399, scope.project.id=66a61523318545c98b246fc2d64ad948) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:05.949699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780d0b-4cf2-453d-93dd-09704a8e5516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:05.949807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09516cda-0f5c-46b7-89a3-e9a932da2dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:05.950598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09516cda-0f5c-46b7-89a3-e9a932da2dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.950883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09516cda-0f5c-46b7-89a3-e9a932da2dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.951133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780d0b-4cf2-453d-93dd-09704a8e5516 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:05.951224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09516cda-0f5c-46b7-89a3-e9a932da2dd9 None admin] PATH_INFO: `/v3/projects/ad8175c8bdea405c88557743edcacad4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.952347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09516cda-0f5c-46b7-89a3-e9a932da2dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=ad8175c8bdea405c88557743edcacad4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:05.953900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09516cda-0f5c-46b7-89a3-e9a932da2dd9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:05.955316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:05.956438 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 215/436] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:05 2022] GET /identity/v3/projects/ad8175c8bdea405c88557743edcacad4 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:05.957810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413a19-1e7f-455f-b785-e26153ee2184 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.958136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413a19-1e7f-455f-b785-e26153ee2184 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.958459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413a19-1e7f-455f-b785-e26153ee2184 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.959953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 216/437] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:05.964984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6413a19-1e7f-455f-b785-e26153ee2184 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:05.973605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 222/438] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:23:05 2022] GET /identity/v3/role_assignments?group.id=882fb7dde4fe4c2f99911dd762c75eb4&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=eb3e1f4520ed4e8f873819a4830e3399 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:05.975477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c427b-7cf4-49aa-8b6d-788ebd4cc66b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:05.975977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c427b-7cf4-49aa-8b6d-788ebd4cc66b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:05.976442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c427b-7cf4-49aa-8b6d-788ebd4cc66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:05.995657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3a3c427b-7cf4-49aa-8b6d-788ebd4cc66b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:05.997347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3a3c427b-7cf4-49aa-8b6d-788ebd4cc66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:06.076924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 223/439] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:06.078978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce743a3-3c98-40cd-ab05-bb02e88e2e38 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.079269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce743a3-3c98-40cd-ab05-bb02e88e2e38 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.079548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce743a3-3c98-40cd-ab05-bb02e88e2e38 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.084972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 224/440] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:06.086878 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeacfdc-3b05-451a-9b33-f483c63fd4fd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.087596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeacfdc-3b05-451a-9b33-f483c63fd4fd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.088017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeacfdc-3b05-451a-9b33-f483c63fd4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.097668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6413a19-1e7f-455f-b785-e26153ee2184 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:06.106394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9eeacfdc-3b05-451a-9b33-f483c63fd4fd None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:06.107859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9eeacfdc-3b05-451a-9b33-f483c63fd4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:06.134833 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3baad-9779-48f1-a3c5-f860d182d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:06.135695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3baad-9779-48f1-a3c5-f860d182d432 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.135973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3baad-9779-48f1-a3c5-f860d182d432 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.136246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3baad-9779-48f1-a3c5-f860d182d432 None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.137484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3baad-9779-48f1-a3c5-f860d182d432 None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:06.138933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3baad-9779-48f1-a3c5-f860d182d432 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:06.140588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 217/441] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:05 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:06.141433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3baad-9779-48f1-a3c5-f860d182d432 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:06.189703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:06.201334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 225/442] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:06.202680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeacfdc-3b05-451a-9b33-f483c63fd4fd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:06.251363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3baad-9779-48f1-a3c5-f860d182d432 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:06.265978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:06.283981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395492ce-fd2b-4edb-a484-f251a705583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:06.284787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395492ce-fd2b-4edb-a484-f251a705583a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.285100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395492ce-fd2b-4edb-a484-f251a705583a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.285378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395492ce-fd2b-4edb-a484-f251a705583a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.295307 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395492ce-fd2b-4edb-a484-f251a705583a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-395492ce-fd2b-4edb-a484-f251a705583a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:06.303898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:06.304938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:06.305754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 218/443] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:06.306683 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395492ce-fd2b-4edb-a484-f251a705583a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:06.313475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeacfdc-3b05-451a-9b33-f483c63fd4fd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:06.349532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:06.350195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.350477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.350755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.351583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] RBAC: Adding query filter params (group.id=882fb7dde4fe4c2f99911dd762c75eb4, role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=ad8175c8bdea405c88557743edcacad4) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:06.351896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:06.353359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:06.359057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 226/444] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:23:06 2022] GET /identity/v3/role_assignments?group.id=882fb7dde4fe4c2f99911dd762c75eb4&scope.project.id=ad8175c8bdea405c88557743edcacad4&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:06.359924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:06.421765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395492ce-fd2b-4edb-a484-f251a705583a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:06.423926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:06.461566 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16240290-0aae-43ce-8f35-64ee57528a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:06.462550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240290-0aae-43ce-8f35-64ee57528a12 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.462839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240290-0aae-43ce-8f35-64ee57528a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.463121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16240290-0aae-43ce-8f35-64ee57528a12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.473288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68dc1e-1f48-47e9-a831-33559a6b9640 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:06.475431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16240290-0aae-43ce-8f35-64ee57528a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-16240290-0aae-43ce-8f35-64ee57528a12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:06.483212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:06.484413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:06.485399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 219/445] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:06.490448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16240290-0aae-43ce-8f35-64ee57528a12 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:06.503441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:06.517471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:06.518163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.518463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.518722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.519489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:06.519797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:06.521252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:06.530640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 227/446] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:06.537917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:06.608567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16240290-0aae-43ce-8f35-64ee57528a12 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:06.655473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c60c14-8657-4b40-8ae9-d1fb6432bc19 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:06.658806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:06.659222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.659506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.659782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.660531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:06.660868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:06.662607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:06.673101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 220/447] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:06.678952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:06.697920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5224f76-3e4f-47ed-9fbe-d2e4e46c1624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:06.698795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5224f76-3e4f-47ed-9fbe-d2e4e46c1624 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.699228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5224f76-3e4f-47ed-9fbe-d2e4e46c1624 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.699503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5224f76-3e4f-47ed-9fbe-d2e4e46c1624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.713477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:06.759197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:06.775305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5224f76-3e4f-47ed-9fbe-d2e4e46c1624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:06.776781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5224f76-3e4f-47ed-9fbe-d2e4e46c1624 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:06.802919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b86489-5b45-426c-80f6-14895de648da None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:06.848651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf66810-cea2-41ba-9b32-a2013d5b8ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:06.849354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf66810-cea2-41ba-9b32-a2013d5b8ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:06.849641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf66810-cea2-41ba-9b32-a2013d5b8ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:06.849919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf66810-cea2-41ba-9b32-a2013d5b8ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:06.892074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 228/448] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:06.897677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5224f76-3e4f-47ed-9fbe-d2e4e46c1624 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:06.923553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf66810-cea2-41ba-9b32-a2013d5b8ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:06.925049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf66810-cea2-41ba-9b32-a2013d5b8ac4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:06.948504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:06.979795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:06.994988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5224f76-3e4f-47ed-9fbe-d2e4e46c1624 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:07.022799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 221/449] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:23:07.027948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51cd75-06d2-4610-9d95-ff97eb35ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:07.028266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf66810-cea2-41ba-9b32-a2013d5b8ac4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:07.028805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51cd75-06d2-4610-9d95-ff97eb35ccbf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:07.029117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51cd75-06d2-4610-9d95-ff97eb35ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:07.029395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51cd75-06d2-4610-9d95-ff97eb35ccbf None admin] PATH_INFO: `/v3/projects/66a61523318545c98b246fc2d64ad948` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:07.030578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51cd75-06d2-4610-9d95-ff97eb35ccbf None admin] RBAC: Authorizing `identity:get_project(project_id=66a61523318545c98b246fc2d64ad948)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:07.032042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51cd75-06d2-4610-9d95-ff97eb35ccbf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:07.033762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 229/450] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:06 2022] GET /identity/v3/projects/66a61523318545c98b246fc2d64ad948 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:07.038948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51cd75-06d2-4610-9d95-ff97eb35ccbf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:07.127220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf66810-cea2-41ba-9b32-a2013d5b8ac4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:07.135879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51cd75-06d2-4610-9d95-ff97eb35ccbf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:07.149647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:07.160242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc4ed-67a4-49ff-8a5b-33d965866ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:07.161114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc4ed-67a4-49ff-8a5b-33d965866ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:07.161399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc4ed-67a4-49ff-8a5b-33d965866ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:07.161683 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc4ed-67a4-49ff-8a5b-33d965866ea6 None admin] PATH_INFO: `/v3/projects/8f1d06ca36e140b391bdeae31455b36e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:07.162858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffc4ed-67a4-49ff-8a5b-33d965866ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1d06ca36e140b391bdeae31455b36e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:07.164304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffc4ed-67a4-49ff-8a5b-33d965866ea6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:07.166223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 222/451] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:23:07 2022] GET /identity/v3/projects/8f1d06ca36e140b391bdeae31455b36e => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:07.169131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a941f-da24-439f-b933-0a0ff129fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:07.169988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a941f-da24-439f-b933-0a0ff129fff2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:07.170275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a941f-da24-439f-b933-0a0ff129fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:07.170555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a941f-da24-439f-b933-0a0ff129fff2 None admin] PATH_INFO: `/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:07.171252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc4ed-67a4-49ff-8a5b-33d965866ea6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:07.171736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a941f-da24-439f-b933-0a0ff129fff2 None admin] RBAC: Authorizing `identity:get_group(group_id=882fb7dde4fe4c2f99911dd762c75eb4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:07.173729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a941f-da24-439f-b933-0a0ff129fff2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:07.175345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 230/452] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:07 2022] GET /identity/v3/groups/882fb7dde4fe4c2f99911dd762c75eb4 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:07.180734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a941f-da24-439f-b933-0a0ff129fff2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:07.204700 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:07.268288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc4ed-67a4-49ff-8a5b-33d965866ea6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:07.278451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a941f-da24-439f-b933-0a0ff129fff2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:07.301922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11352e4-fdd2-4de2-9ca5-f4889971a0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:07.302777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11352e4-fdd2-4de2-9ca5-f4889971a0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:07.303062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11352e4-fdd2-4de2-9ca5-f4889971a0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:07.303339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11352e4-fdd2-4de2-9ca5-f4889971a0b6 None admin] PATH_INFO: `/v3/groups/b20bca8dd5f2415291f8fac1ed209b1b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:07.304522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11352e4-fdd2-4de2-9ca5-f4889971a0b6 None admin] RBAC: Authorizing `identity:get_group(group_id=b20bca8dd5f2415291f8fac1ed209b1b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:07.306003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11352e4-fdd2-4de2-9ca5-f4889971a0b6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:07.307616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 223/453] 10.222.0.79 () {56 vars in 1180 bytes} [Fri May 27 09:23:07 2022] GET /identity/v3/groups/b20bca8dd5f2415291f8fac1ed209b1b => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:07.313677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11352e4-fdd2-4de2-9ca5-f4889971a0b6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:07.313791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a9887-018c-40b8-a358-50ee03b92f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:07.314407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9887-018c-40b8-a358-50ee03b92f93 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:07.314691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9887-018c-40b8-a358-50ee03b92f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:07.314975 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9887-018c-40b8-a358-50ee03b92f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:07.315808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a9887-018c-40b8-a358-50ee03b92f93 None admin] RBAC: Adding query filter params (group.id=882fb7dde4fe4c2f99911dd762c75eb4, role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=66a61523318545c98b246fc2d64ad948) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:07.316123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a9887-018c-40b8-a358-50ee03b92f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:07.317579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a9887-018c-40b8-a358-50ee03b92f93 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:07.323474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 231/454] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:23:07 2022] GET /identity/v3/role_assignments?group.id=882fb7dde4fe4c2f99911dd762c75eb4&scope.project.id=66a61523318545c98b246fc2d64ad948&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:07.373898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:07.417479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11352e4-fdd2-4de2-9ca5-f4889971a0b6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:07.451936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26204dc2-7416-425d-a781-27596a50a08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:07.452604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204dc2-7416-425d-a781-27596a50a08b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:07.452916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204dc2-7416-425d-a781-27596a50a08b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:07.453829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204dc2-7416-425d-a781-27596a50a08b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:07.454686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26204dc2-7416-425d-a781-27596a50a08b None admin] RBAC: Adding query filter params (group.id=b20bca8dd5f2415291f8fac1ed209b1b, role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=8f1d06ca36e140b391bdeae31455b36e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:07.454999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26204dc2-7416-425d-a781-27596a50a08b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:07.456469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26204dc2-7416-425d-a781-27596a50a08b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:07.463318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 224/455] 10.222.0.79 () {56 vars in 1376 bytes} [Fri May 27 09:23:07 2022] GET /identity/v3/role_assignments?group.id=b20bca8dd5f2415291f8fac1ed209b1b&scope.project.id=8f1d06ca36e140b391bdeae31455b36e&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:10.101552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585e0f3-aba9-42d5-b462-76a866d06de6 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.102504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585e0f3-aba9-42d5-b462-76a866d06de6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.102998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585e0f3-aba9-42d5-b462-76a866d06de6 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.104785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 232/456] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:10.110274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b6f1-60b4-4970-8e5a-1cfb1efa37f3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.111135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b6f1-60b4-4970-8e5a-1cfb1efa37f3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.111625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b6f1-60b4-4970-8e5a-1cfb1efa37f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.137886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7e03b6f1-60b4-4970-8e5a-1cfb1efa37f3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:10.139477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7e03b6f1-60b4-4970-8e5a-1cfb1efa37f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:10.247759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 225/457] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:10.285964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585e0f3-aba9-42d5-b462-76a866d06de6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:10.387813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43331f6-4816-4674-ad59-20f53f57ab33 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.388020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43331f6-4816-4674-ad59-20f53f57ab33 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.388461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43331f6-4816-4674-ad59-20f53f57ab33 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.390353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 226/458] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:10.406862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c97a1c-2126-410e-b849-158f6302fb7e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.407478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c97a1c-2126-410e-b849-158f6302fb7e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.407961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c97a1c-2126-410e-b849-158f6302fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.418051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:10.432874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-27c97a1c-2126-410e-b849-158f6302fb7e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:10.433106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-27c97a1c-2126-410e-b849-158f6302fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:10.443137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585e0f3-aba9-42d5-b462-76a866d06de6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:10.479919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:10.481201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.481707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.482206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.489382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:10.494940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:10.496975 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:10.508213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 227/459] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:10.509793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d097ef-1635-4b16-9add-a281f0b2cdef None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.510229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d097ef-1635-4b16-9add-a281f0b2cdef None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.510654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d097ef-1635-4b16-9add-a281f0b2cdef None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.512290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 228/460] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:10.520249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bad1-f3c4-4759-9c7b-a56aea75679e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.520249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bad1-f3c4-4759-9c7b-a56aea75679e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.520249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bad1-f3c4-4759-9c7b-a56aea75679e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:10.520508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:10.521363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:10.522230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:10.522230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:10.522230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:10.522230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:10.522230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 233/461] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:10.529867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:10.545228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c5e6bad1-f3c4-4759-9c7b-a56aea75679e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:10.546854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c5e6bad1-f3c4-4759-9c7b-a56aea75679e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:10.629100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 229/462] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:10.630278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6bad1-f3c4-4759-9c7b-a56aea75679e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:10.650454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300105-7dd2-4191-b949-ba9397dd35e9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:10.693472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:10.694619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.695493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.695939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.697075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:10.697748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:10.699609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:10.709190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:10.717294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 234/463] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:10.718122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:10.766993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6bad1-f3c4-4759-9c7b-a56aea75679e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:10.785218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:10.810648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:10.811463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.812007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.812314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.826207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:10.827719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:10.828574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46959a7-d8d6-4423-8e7b-9554d09ba667 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:10.853073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:10.854006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:10.854888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:10.854888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:10.854888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:10.854888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:10.854888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 230/464] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:10.860892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:10.887303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:10.888112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:10.888392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:10.888665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:10.900646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:10.902099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:10.920183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:10.921095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:10.922074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:10.922074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:10.922074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:10.922074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:10.922074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 235/465] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:10.922352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:10.980448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:10.994143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd64460-11bf-40aa-b8cb-d617f0517140 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:11.034732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1236d-f3a1-42ad-980b-d5db8a7e9fe8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:11.038303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781621f-195f-4ba3-831e-91f508ce864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:11.038991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781621f-195f-4ba3-831e-91f508ce864b None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.039279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781621f-195f-4ba3-831e-91f508ce864b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.039560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781621f-195f-4ba3-831e-91f508ce864b None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.040274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781621f-195f-4ba3-831e-91f508ce864b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:11.043119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781621f-195f-4ba3-831e-91f508ce864b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:11.072857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 231/466] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:23:10 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:11.072857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781621f-195f-4ba3-831e-91f508ce864b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:11.088151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ba575-4b08-4f21-9b98-89921fec7998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:11.089684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba575-4b08-4f21-9b98-89921fec7998 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.090079 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba575-4b08-4f21-9b98-89921fec7998 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.090535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba575-4b08-4f21-9b98-89921fec7998 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.091858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba575-4b08-4f21-9b98-89921fec7998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:11.092451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba575-4b08-4f21-9b98-89921fec7998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:11.095183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba575-4b08-4f21-9b98-89921fec7998 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:11.106339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:11.112840 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 236/467] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:11.115423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e0d1-c9b4-4547-9ff1-cf0cf1755977 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.115715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e0d1-c9b4-4547-9ff1-cf0cf1755977 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.116249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e0d1-c9b4-4547-9ff1-cf0cf1755977 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.118603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 237/468] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:11.119169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e0d1-c9b4-4547-9ff1-cf0cf1755977 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:11.202500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781621f-195f-4ba3-831e-91f508ce864b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:11.246355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b89ae6-95c8-4bde-9b61-d85cfc27a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:11.247104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89ae6-95c8-4bde-9b61-d85cfc27a6ff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.247405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89ae6-95c8-4bde-9b61-d85cfc27a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.247694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89ae6-95c8-4bde-9b61-d85cfc27a6ff None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.248472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b89ae6-95c8-4bde-9b61-d85cfc27a6ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:11.248784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b89ae6-95c8-4bde-9b61-d85cfc27a6ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:11.251716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b89ae6-95c8-4bde-9b61-d85cfc27a6ff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:11.267829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e0d1-c9b4-4547-9ff1-cf0cf1755977 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:11.270653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 232/469] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:11.273086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b60252-7e63-4932-931b-6fa1ddd349b5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.273379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b60252-7e63-4932-931b-6fa1ddd349b5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.273663 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b60252-7e63-4932-931b-6fa1ddd349b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.283343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:11.297319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-67b60252-7e63-4932-931b-6fa1ddd349b5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:11.298921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-67b60252-7e63-4932-931b-6fa1ddd349b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:11.322268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05555-24a9-4839-b6d9-4c3305bca880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:11.323310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05555-24a9-4839-b6d9-4c3305bca880 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.323786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05555-24a9-4839-b6d9-4c3305bca880 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.324256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05555-24a9-4839-b6d9-4c3305bca880 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.325715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05555-24a9-4839-b6d9-4c3305bca880 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:11.327990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05555-24a9-4839-b6d9-4c3305bca880 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:11.356562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 238/470] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:23:11 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:11.357259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05555-24a9-4839-b6d9-4c3305bca880 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:11.393928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 233/471] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:11.432299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b60252-7e63-4932-931b-6fa1ddd349b5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:11.458002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:11.491334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05555-24a9-4839-b6d9-4c3305bca880 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:11.528553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58690d22-d343-4516-b77b-2dd6340a6d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:11.529292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690d22-d343-4516-b77b-2dd6340a6d9f None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.529579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690d22-d343-4516-b77b-2dd6340a6d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.529855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58690d22-d343-4516-b77b-2dd6340a6d9f None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.530568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58690d22-d343-4516-b77b-2dd6340a6d9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:11.532180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58690d22-d343-4516-b77b-2dd6340a6d9f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:11.555193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 239/472] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:23:11 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:11.561878 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db23be-37e9-4fb9-8acd-6b36319e5581 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.562240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db23be-37e9-4fb9-8acd-6b36319e5581 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.563146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db23be-37e9-4fb9-8acd-6b36319e5581 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.564696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 240/473] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:11.565007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b60252-7e63-4932-931b-6fa1ddd349b5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:11.570837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7130-6f8c-4c1c-9f2b-d9a9a25b6069 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.571196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7130-6f8c-4c1c-9f2b-d9a9a25b6069 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.571483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7130-6f8c-4c1c-9f2b-d9a9a25b6069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.594401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-581a7130-6f8c-4c1c-9f2b-d9a9a25b6069 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:11.595633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-581a7130-6f8c-4c1c-9f2b-d9a9a25b6069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:11.615633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:11.616858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:11.618236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.618941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.619422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.636482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:11.638284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:11.659680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:11.660612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:11.661504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:11.661504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:11.661504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:11.661504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:11.661504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 234/474] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:11.669939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:11.681344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 241/475] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:11.705144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a7130-6f8c-4c1c-9f2b-d9a9a25b6069 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:11.744546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:11.786663 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28900c-b6d2-4709-973e-52e78fd72727 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:11.827700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:11.827700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.828005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.828229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.829821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:11.830137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:11.831502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a7130-6f8c-4c1c-9f2b-d9a9a25b6069 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:11.831613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:11.847094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 235/476] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:11.852507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:11.878983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:11.879666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:11.879948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:11.880225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:11.881690 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:11.883544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:11.890772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.sql.core [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:23:11.890772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 09:23:11.890772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [parameters: {'id': 'f016e55269f743f896927c227c0d6ef4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 09:23:11.890772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application conn.query(q) May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application result.read() May 27 09:23:11.907753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return ref.to_dict() May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:23:11.908694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application next(self.gen) May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application yield resource May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application next(self.gen) May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise self.value May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application session.commit() May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:23:11.910003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.session.flush() May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application compat.raise_( May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:23:11.910957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:23:11.911888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application conn.query(q) May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application result.read() May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:23:11.912710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [parameters: {'id': 'f016e55269f743f896927c227c0d6ef4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:11.915163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 09:23:11.917371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:11.919327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 242/477] 10.222.0.79 () {60 vars in 1131 bytes} [Fri May 27 09:23:11 2022] POST /identity/v3/roles => generated 144 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:11.919327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:11.947073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:11.987821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dae98-3610-496d-afc8-8e2a98c9aa61 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:12.022876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:12.033348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1df1a-3b67-4ecf-beb0-471f9d0631b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:12.034115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1df1a-3b67-4ecf-beb0-471f9d0631b1 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:12.034471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1df1a-3b67-4ecf-beb0-471f9d0631b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:12.034827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1df1a-3b67-4ecf-beb0-471f9d0631b1 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:12.035623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1df1a-3b67-4ecf-beb0-471f9d0631b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:12.037101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1df1a-3b67-4ecf-beb0-471f9d0631b1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:12.048536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c9b6-7196-4245-9d85-37ddcf4f6959 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:12.075821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 236/478] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:23:11 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:23:12.097748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9be646-25fa-482a-8887-d20f1c61bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:12.098588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be646-25fa-482a-8887-d20f1c61bb77 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:12.098872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be646-25fa-482a-8887-d20f1c61bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:12.099152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be646-25fa-482a-8887-d20f1c61bb77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:12.114854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9be646-25fa-482a-8887-d20f1c61bb77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-fd9be646-25fa-482a-8887-d20f1c61bb77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:12.123308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:12.124201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:23:12.125597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:12.129876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 243/479] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:12.138014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1df1a-3b67-4ecf-beb0-471f9d0631b1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:12.325140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1df1a-3b67-4ecf-beb0-471f9d0631b1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:12.358850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa37803-81fa-49e4-8f3a-d3060e9810b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:12.360066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa37803-81fa-49e4-8f3a-d3060e9810b8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:12.360354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa37803-81fa-49e4-8f3a-d3060e9810b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:12.360637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa37803-81fa-49e4-8f3a-d3060e9810b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:12.361417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa37803-81fa-49e4-8f3a-d3060e9810b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:12.361727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa37803-81fa-49e4-8f3a-d3060e9810b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:12.363106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa37803-81fa-49e4-8f3a-d3060e9810b8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:12.376968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 237/480] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:13.906011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5667d27-c8e7-4e10-8771-78e24a6e449d None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:13.907055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5667d27-c8e7-4e10-8771-78e24a6e449d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:13.907161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5667d27-c8e7-4e10-8771-78e24a6e449d None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:13.908747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 244/481] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:13.914239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c844bf-2fae-4e31-b49f-5011353e6c6b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:13.914638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c844bf-2fae-4e31-b49f-5011353e6c6b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:13.914818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c844bf-2fae-4e31-b49f-5011353e6c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:13.941910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-47c844bf-2fae-4e31-b49f-5011353e6c6b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:13.943142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-47c844bf-2fae-4e31-b49f-5011353e6c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:13.981259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:14.020993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 238/482] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:14.041212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5667d27-c8e7-4e10-8771-78e24a6e449d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:14.153827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:14.190570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5667d27-c8e7-4e10-8771-78e24a6e449d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:14.197066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247cc6-7dd0-463d-ab76-250fc34b6599 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.197361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247cc6-7dd0-463d-ab76-250fc34b6599 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.197643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247cc6-7dd0-463d-ab76-250fc34b6599 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.199010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 239/483] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:14.204154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f4816-c0b5-4c74-9f32-e094f48ced9a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.204446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f4816-c0b5-4c74-9f32-e094f48ced9a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.204728 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f4816-c0b5-4c74-9f32-e094f48ced9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.224888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f13f4816-c0b5-4c74-9f32-e094f48ced9a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:14.226102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f13f4816-c0b5-4c74-9f32-e094f48ced9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:14.249513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8e6c7-7102-4bcd-aa9a-46a0df1b1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:14.250848 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e6c7-7102-4bcd-aa9a-46a0df1b1388 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.251131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e6c7-7102-4bcd-aa9a-46a0df1b1388 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.251409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e6c7-7102-4bcd-aa9a-46a0df1b1388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.277151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8e6c7-7102-4bcd-aa9a-46a0df1b1388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b4d8e6c7-7102-4bcd-aa9a-46a0df1b1388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:14.288871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:14.289777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:14.291002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 245/484] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:14.302341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8e6c7-7102-4bcd-aa9a-46a0df1b1388 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:14.362211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 240/485] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:14.367665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281726ba-ddb7-4387-9d25-829bbd52795c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.368190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281726ba-ddb7-4387-9d25-829bbd52795c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.368667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281726ba-ddb7-4387-9d25-829bbd52795c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.374317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 241/486] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:14.382167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef008f-b040-4cda-9cef-eafd0f85ba83 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.382711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef008f-b040-4cda-9cef-eafd0f85ba83 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.383241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef008f-b040-4cda-9cef-eafd0f85ba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.404617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3eef008f-b040-4cda-9cef-eafd0f85ba83 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:14.406988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3eef008f-b040-4cda-9cef-eafd0f85ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:14.430959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8e6c7-7102-4bcd-aa9a-46a0df1b1388 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:14.468065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:14.469050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.469636 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.470060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.470979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:14.471435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:14.473028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:14.475833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:14.488910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 246/487] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:14.490075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:14.499003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 242/488] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:14.500740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef008f-b040-4cda-9cef-eafd0f85ba83 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:14.536292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:14.612878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef008f-b040-4cda-9cef-eafd0f85ba83 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:14.641728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76a930-2b96-4b94-91b0-ad64329230d0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:14.649492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:14.650595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.651082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.651561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.662604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:14.664507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:14.681914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019175b4-cf31-43e8-9afc-389c4b9f8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:14.682715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019175b4-cf31-43e8-9afc-389c4b9f8c9b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.682998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019175b4-cf31-43e8-9afc-389c4b9f8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.683276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019175b4-cf31-43e8-9afc-389c4b9f8c9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:14.685350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:14.686178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:14.687043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:14.687043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:14.687043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:14.687043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:14.689527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 243/489] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:14.690874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:14.695961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019175b4-cf31-43e8-9afc-389c4b9f8c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-019175b4-cf31-43e8-9afc-389c4b9f8c9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:14.705607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:14.706567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 247/490] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:14.708020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019175b4-cf31-43e8-9afc-389c4b9f8c9b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:14.785055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:14.788684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:14.806007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9e95d-f60f-4742-ad91-f5f202f809be None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:14.837779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019175b4-cf31-43e8-9afc-389c4b9f8c9b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:14.850461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17d2fa-b423-49bf-bb08-13db6ad8bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:14.851286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17d2fa-b423-49bf-bb08-13db6ad8bb82 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.851570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17d2fa-b423-49bf-bb08-13db6ad8bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.851850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17d2fa-b423-49bf-bb08-13db6ad8bb82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.868577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17d2fa-b423-49bf-bb08-13db6ad8bb82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4b17d2fa-b423-49bf-bb08-13db6ad8bb82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:14.879530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:14.880697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:14.881714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:14.884278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 244/491] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:14.885306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17d2fa-b423-49bf-bb08-13db6ad8bb82 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:14.888994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:14.890030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:14.890556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:14.891060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:14.892121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:14.892733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:14.894422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:14.910398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 248/492] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:14.912066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.014831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17d2fa-b423-49bf-bb08-13db6ad8bb82 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.036068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed85ba6-1c4e-428c-a614-2b6cebed317b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.054678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.055681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.056173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.056601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.057526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:15.058135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.058577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:15.059583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.068332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 245/493] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:15.069448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.079823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ff3d4-0457-4cb5-a08d-918c68caeb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.080552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff3d4-0457-4cb5-a08d-918c68caeb1f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.080860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff3d4-0457-4cb5-a08d-918c68caeb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.081145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff3d4-0457-4cb5-a08d-918c68caeb1f None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.081890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ff3d4-0457-4cb5-a08d-918c68caeb1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:15.082200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ff3d4-0457-4cb5-a08d-918c68caeb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.082839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:15.083570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ff3d4-0457-4cb5-a08d-918c68caeb1f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.092960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 249/494] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:15.094765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26a41-dd95-46a9-a930-0c0ef7a3456f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.095054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26a41-dd95-46a9-a930-0c0ef7a3456f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.095331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26a41-dd95-46a9-a930-0c0ef7a3456f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.096738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 250/495] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:15.097265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f26a41-dd95-46a9-a930-0c0ef7a3456f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.191161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77bae2-bdfa-4b69-bfba-4b5e8ac6ef76 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.204599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f26a41-dd95-46a9-a930-0c0ef7a3456f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.226510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78cec1-ccc3-4f5e-90d8-ff44d7c9c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.227395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78cec1-ccc3-4f5e-90d8-ff44d7c9c7af None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.227678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78cec1-ccc3-4f5e-90d8-ff44d7c9c7af None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.227961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78cec1-ccc3-4f5e-90d8-ff44d7c9c7af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.235265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78cec1-ccc3-4f5e-90d8-ff44d7c9c7af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.236711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78cec1-ccc3-4f5e-90d8-ff44d7c9c7af None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.237809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.238599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.238882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.239166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.249363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.250840 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1a78cec1-ccc3-4f5e-90d8-ff44d7c9c7af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:15.251706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:15.252747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:15.253740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 246/496] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:15.254315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffedfd-e7a9-4ed2-85f9-06910baa1566 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.254315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffedfd-e7a9-4ed2-85f9-06910baa1566 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.254589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffedfd-e7a9-4ed2-85f9-06910baa1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:15.270719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:15.271796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:15.272668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:15.272668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:15.272668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:15.272668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:15.272668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 251/497] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:15.272668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.277363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-90ffedfd-e7a9-4ed2-85f9-06910baa1566 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:15.278598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-90ffedfd-e7a9-4ed2-85f9-06910baa1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:15.307456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:15.341595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:15.349753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 247/498] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:15.351032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02003200-3c90-4aed-a1bf-cf942e9456de None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.351316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02003200-3c90-4aed-a1bf-cf942e9456de None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.351589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02003200-3c90-4aed-a1bf-cf942e9456de None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.353080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 248/499] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:15.353668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02003200-3c90-4aed-a1bf-cf942e9456de None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.384560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4101a-b94d-4d5f-905e-37f1d7c3f95c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.417887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.418669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.418957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.419230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.429466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.430907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:15.448016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:15.448920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:15.449802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:15.449802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:15.449802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:15.449802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:15.449802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 252/500] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:15.450077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.464222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02003200-3c90-4aed-a1bf-cf942e9456de None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.497712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ded6e-bb78-41ca-ac4b-0a150413d2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.498373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ded6e-bb78-41ca-ac4b-0a150413d2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.498655 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ded6e-bb78-41ca-ac4b-0a150413d2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.498935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ded6e-bb78-41ca-ac4b-0a150413d2c6 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.499821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ded6e-bb78-41ca-ac4b-0a150413d2c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:15.500131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ded6e-bb78-41ca-ac4b-0a150413d2c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.501614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ded6e-bb78-41ca-ac4b-0a150413d2c6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.535375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:15.537504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 249/501] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:15.539040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ca60-05f5-43fb-9ee4-67067db17a1b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.539330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ca60-05f5-43fb-9ee4-67067db17a1b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.539610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ca60-05f5-43fb-9ee4-67067db17a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.551818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b1b5-9dbf-4798-8bc4-ab460ca14acf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.556299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9627ca60-05f5-43fb-9ee4-67067db17a1b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:15.557524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9627ca60-05f5-43fb-9ee4-67067db17a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:15.585193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.585917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.586207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.586491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.587474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:15.587785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.589173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.600672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 253/502] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:15.601492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.606045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:15.623023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 250/503] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:15.623823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ca60-05f5-43fb-9ee4-67067db17a1b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.703679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3530bad-f446-4f84-a92d-0ce5d9377973 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.719187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ca60-05f5-43fb-9ee4-67067db17a1b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.736627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e38279-3176-4110-98b3-0df4c8b43c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.737465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e38279-3176-4110-98b3-0df4c8b43c6e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.737747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e38279-3176-4110-98b3-0df4c8b43c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.738017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e38279-3176-4110-98b3-0df4c8b43c6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.747853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e38279-3176-4110-98b3-0df4c8b43c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:15.752201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.752876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.753159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.753430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.754137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:15.754441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.755824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-61e38279-3176-4110-98b3-0df4c8b43c6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:15.756096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:15.757008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:15.757905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 254/504] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:15.758578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e38279-3176-4110-98b3-0df4c8b43c6e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.761349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:15.769594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 251/505] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:15.770658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.814795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:15.856217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e38279-3176-4110-98b3-0df4c8b43c6e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.867990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586dab0-8ff1-454a-8bf6-ad44573f8721 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:15.888715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939cc17-8291-438d-9d80-cacb7263ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.889388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939cc17-8291-438d-9d80-cacb7263ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.889671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939cc17-8291-438d-9d80-cacb7263ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.889947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939cc17-8291-438d-9d80-cacb7263ecb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.901951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:15.902733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:15.903015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:15.903289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:15.912007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.913493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:15.927622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:15.928588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 252/506] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:15.929640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:15.957738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939cc17-8291-438d-9d80-cacb7263ecb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:15.959181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939cc17-8291-438d-9d80-cacb7263ecb3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:15.961750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.027777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e7f40-de21-48db-a8b0-2ba2b932878e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.030027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.056008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 255/507] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:16.056940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939cc17-8291-438d-9d80-cacb7263ecb3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.066568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.067429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.067713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.067987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.078324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.079792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:16.096754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:16.097795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:16.098784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:16.098784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:16.098784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:16.098784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:16.098784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 253/508] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:16.099136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.154602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939cc17-8291-438d-9d80-cacb7263ecb3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.157186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.188719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.189419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.189699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.189980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.190715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:16.191019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.192377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.197462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7aebe-e716-4507-8312-a42ae9701a6a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.199986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 256/509] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:16.200761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.235386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.236170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.236454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.236729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.244078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.245550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:16.259808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:16.260883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:16.261836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 254/510] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:16.262399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.283444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.303970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9532dd-ceb2-4eb9-a386-6c872c342761 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.336591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.337476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.337760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.338140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.338977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:16.339285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.340721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.364966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dbef1-8fbb-4eda-bb43-323c693cde89 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.377315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 257/511] 10.222.0.79 () {56 vars in 1137 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:16.378131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.401328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.401645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.402512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.402830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.403066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.414045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.415517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:16.432672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:16.433624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:16.434476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:16.434476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:16.434476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:16.434476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:16.434476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 255/512] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:16.435065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.483474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ecae2-7e5f-4d88-b182-9adc32e6c106 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.500734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.516201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.516916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.517202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.517477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.518193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:16.518495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.519859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.530641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 258/513] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:16.531963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.533385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8124d5-233c-49c2-b2a3-ab3210303a02 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.568297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.569113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.569403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.569685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.579594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.581084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:16.599541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:16.600456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:16.601360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:16.601360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:16.601360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:16.601360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:16.601360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 256/514] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:16.601623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.615126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.630677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddf6d-590c-425f-8687-bf58ad569725 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.662953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.663620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.663911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.664182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.665057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:16.665367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.666811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.684108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 259/515] 10.222.0.79 () {56 vars in 1137 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:16.684735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.700232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29152c-db5e-4487-b2ec-cad55331469b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.720554 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.734282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089217b-58c3-42a2-8da1-1380ea1d3f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.734925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089217b-58c3-42a2-8da1-1380ea1d3f74 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.735203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089217b-58c3-42a2-8da1-1380ea1d3f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.735479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089217b-58c3-42a2-8da1-1380ea1d3f74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.783142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3a01-bf5f-4e80-9748-72a0cbb33d70 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.800618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089217b-58c3-42a2-8da1-1380ea1d3f74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.802181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089217b-58c3-42a2-8da1-1380ea1d3f74 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.816768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.817461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.817749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.818032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.818777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:16.819086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.820439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.831803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 260/516] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:16.832564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.834990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.901786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 257/517] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:16.902549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089217b-58c3-42a2-8da1-1380ea1d3f74 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:16.926633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:16.932272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d92c4e-959c-42fd-80b5-cc9eeba92d27 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:16.965403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0814a4-88e4-48df-9963-246199769c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:16.966077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0814a4-88e4-48df-9963-246199769c9f None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:16.966365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0814a4-88e4-48df-9963-246199769c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:16.966716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0814a4-88e4-48df-9963-246199769c9f None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:16.967422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0814a4-88e4-48df-9963-246199769c9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:16.969463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0814a4-88e4-48df-9963-246199769c9f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:16.988648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 261/518] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:23:16 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:16.989497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0814a4-88e4-48df-9963-246199769c9f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.020907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089217b-58c3-42a2-8da1-1380ea1d3f74 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.055154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:17.066466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.067157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.067428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.067703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.068446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:17.068755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.070177 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.086266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 258/519] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:17.087448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.112245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0814a4-88e4-48df-9963-246199769c9f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.153159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2e598-2db8-46cb-ba0b-789fb633d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.153735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2e598-2db8-46cb-ba0b-789fb633d64c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.154026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2e598-2db8-46cb-ba0b-789fb633d64c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.154307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2e598-2db8-46cb-ba0b-789fb633d64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.180195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:17.204876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7d69-4434-4019-99d4-7aee1377b5a8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.236974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2e598-2db8-46cb-ba0b-789fb633d64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.238965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2e598-2db8-46cb-ba0b-789fb633d64c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.243073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.243872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.244150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.244424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.251948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.253439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:17.268764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:17.269827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 259/520] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:17.270876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.312622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:17.360937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 262/521] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:17.360937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2e598-2db8-46cb-ba0b-789fb633d64c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.384423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f3d43-5d1e-4660-b4fc-104ad88d8ca5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.419731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.420445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.420729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.421039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.429937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:17.432011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.433849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:17.452024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:17.453149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:17.454156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:17.454156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:17.454156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:17.454156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:17.454156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 260/522] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:17.454156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.480101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2e598-2db8-46cb-ba0b-789fb633d64c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.519036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.520069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.520500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.520980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.528782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.530403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:17.547824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:17.548970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:23:17.550086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:17.552423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 263/523] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:17.553516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.560477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cdd78-a9d9-4d50-baf8-6a90c59bf288 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.576160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:17.595858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.596524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.596809 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.597115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.597902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:17.598214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.599649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.618248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 261/524] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:17.619056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.664005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc28411-9fe7-4ac1-ac22-cad85c6addcd None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.674669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:17.700903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.701840 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.702219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.702502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.713032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.714487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.725968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b82c35-6f79-4d39-95a6-cc40ad2af909 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:17.731972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:17.733074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:17.739174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:17.739174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:17.739174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:17.739174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:17.739174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 264/525] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:17.739174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.770234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.770992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.771350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.771699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.772489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:17.772892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.774342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.786987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 262/526] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:17.786987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.813510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:17.847650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285ef13-cb46-4ecf-87c9-f20a358ee2d2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.882668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.883334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.883616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.883893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.884727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:17.885065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.886587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.899239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41561c-31c5-41e0-80a2-632a42120f70 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:17.908326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 265/527] 10.222.0.79 () {56 vars in 1139 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:17.908326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:17.915487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:17.940653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:17.941379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:17.941651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:17.941927 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:17.942757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=742917921213432a8ec7853ccf988fdf) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:17.943067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:17.944619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:17.950147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 263/528] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/role_assignments?user.id=742917921213432a8ec7853ccf988fdf&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:17.953738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.033993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd49ac6-264c-42ed-975a-c982f71c1cd4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.065719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:18.083638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.084485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.084896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.085279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.086379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:18.086666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.088443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.103270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6a7b2-66d3-4cdf-9f58-0ddbaa1affc5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.107110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 266/529] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:18.108865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.153679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.154732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.155015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.155293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.163411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.165077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:18.183103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:18.184176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 264/530] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:18.185577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.223791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9dbd7-1801-4a20-93bf-137204cb4d7f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.223989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:18.260002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1074-eb52-41e3-8560-6080bc938d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.260959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1074-eb52-41e3-8560-6080bc938d84 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.261348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1074-eb52-41e3-8560-6080bc938d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.261826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1074-eb52-41e3-8560-6080bc938d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.314098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1c679-84d3-448a-88b8-3c92ef39acb7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.330852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:18.347079 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb1074-eb52-41e3-8560-6080bc938d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.348565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb1074-eb52-41e3-8560-6080bc938d84 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.351003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.351987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.352419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.352859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.360150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.361808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:18.375897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:18.376978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:18.378017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:18.378017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:18.378017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:18.378017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:18.378017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:18.378017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:18.378017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:18.378017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:18.380012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 265/531] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:18.380970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.461214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 267/532] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:18.462568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1074-eb52-41e3-8560-6080bc938d84 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.510002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b75e5d-5050-4924-9b5a-bc46b2388cff None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.521796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:18.559838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.561143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.561521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.562633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.563506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:18.563891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.566237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.572371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:18.584359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 266/533] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:18.585607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.598092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1074-eb52-41e3-8560-6080bc938d84 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.634335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.635291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.635761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.636220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.637255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:18.637748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.639354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.658625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 268/534] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:18.659743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.714695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170e5f-15bc-4f3c-ab81-d8e826b9f692 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.751128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.752233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.752700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.753190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.764465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.766867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:18.786260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:18.787169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:18.788030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:18.788030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:18.788030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:18.788030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:18.790393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 267/535] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:18.790513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c60e84-651e-4c96-966a-d963b0076771 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.791498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.804335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:18.841784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.842942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.843445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.843903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.844989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=fe6a8bf853cd4b60916375d9ebbd468f) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:18.845514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.847171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.861165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 269/536] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:18 2022] GET /identity/v3/role_assignments?user.id=fe6a8bf853cd4b60916375d9ebbd468f&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:18.862494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:18.886789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:18.919759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b835a-9da8-4bea-b225-fe6f60bbab94 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:18.969080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:18.970017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:18.970450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:18.970878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:18.971884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=2b11f7990b364f5281def98b941e1e00) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:18.974699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:18.976410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:18.991184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 268/537] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:18 2022] GET /identity/v3/role_assignments?user.id=2b11f7990b364f5281def98b941e1e00&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:19.039205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76172f6-4814-42a4-a372-83deec0c11ff None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:19.088556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:19.089578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:19.090030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:19.090461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:19.091384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:19.091871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:19.093550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:19.110911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 270/538] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:19.117187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:19.199261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:19.233123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0596-8473-4be3-b9dc-dcdb0bf9def7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:19.270273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40353016-c130-496f-a332-44777032a9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:19.271344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353016-c130-496f-a332-44777032a9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:19.271777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353016-c130-496f-a332-44777032a9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:19.272198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353016-c130-496f-a332-44777032a9d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:19.279628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40353016-c130-496f-a332-44777032a9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:19.281906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40353016-c130-496f-a332-44777032a9d4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-40353016-c130-496f-a332-44777032a9d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:19.297239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:19.298104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:19.299032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:19.299032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:19.299032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:19.299032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:19.299032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:19.299032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:19.299032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:19.299032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:19.301183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 269/539] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:19.306682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:19.314399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1130-6b2d-4698-93b3-0e9731d63318 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:19.314690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1130-6b2d-4698-93b3-0e9731d63318 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:19.314978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1130-6b2d-4698-93b3-0e9731d63318 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:19.316620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 270/540] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:19.321811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710326-298f-435c-9ee6-6e7bcf9d76c3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:19.322189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710326-298f-435c-9ee6-6e7bcf9d76c3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:19.322373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710326-298f-435c-9ee6-6e7bcf9d76c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:19.344942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-50710326-298f-435c-9ee6-6e7bcf9d76c3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:19.345676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-50710326-298f-435c-9ee6-6e7bcf9d76c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:19.435040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:19.461014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 271/541] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:19.466417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31383da7-aed5-40aa-86e0-b9504c07689f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:19.491824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50710326-298f-435c-9ee6-6e7bcf9d76c3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:19.522213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:19.522875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:19.523155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:19.523430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:19.524215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:19.524521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:19.525984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:19.547117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 271/542] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:19.554471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:19.613306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:19.651975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50710326-298f-435c-9ee6-6e7bcf9d76c3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:19.693562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bd125-02be-4c44-83b4-f97f3e802019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:19.694642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bd125-02be-4c44-83b4-f97f3e802019 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:19.694922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bd125-02be-4c44-83b4-f97f3e802019 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:19.695357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bd125-02be-4c44-83b4-f97f3e802019 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:19.707048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bd125-02be-4c44-83b4-f97f3e802019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-293bd125-02be-4c44-83b4-f97f3e802019 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:19.715876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:19.716784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:19.717875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 272/543] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:19.724556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bd125-02be-4c44-83b4-f97f3e802019 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:19.744006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019feada-3767-41dc-8a69-66f439cbc5d8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:19.812050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:19.825570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:19.826589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:19.827080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:19.827613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:19.828668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=ebee38389afb4270b18c6a14c7a4e302) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:19.829234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:19.830871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:19.839245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bd125-02be-4c44-83b4-f97f3e802019 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:19.847986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 272/544] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:19 2022] GET /identity/v3/role_assignments?user.id=ebee38389afb4270b18c6a14c7a4e302&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:19.877279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:19.885525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:19.886295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:19.886635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:19.886923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:19.887733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:19.888060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:19.889524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:19.904192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 273/545] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:19.914033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:20.094249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358acf-7490-4bde-9c77-c884df40fc5f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:20.147373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:20.148183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:20.148476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:20.148756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:20.165056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:20.166514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:20.187493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:20.188349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:20.189214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:20.189214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:20.189214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:20.189214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:20.189214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 273/546] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:20.194457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:20.320806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030baa-a336-4399-9d3d-16caa983d34b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:20.387030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63cb9a-e90a-4020-84ef-f98c6649813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:20.387636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cb9a-e90a-4020-84ef-f98c6649813d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:20.387924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cb9a-e90a-4020-84ef-f98c6649813d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:20.388205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63cb9a-e90a-4020-84ef-f98c6649813d None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:20.388965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63cb9a-e90a-4020-84ef-f98c6649813d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:20.389279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63cb9a-e90a-4020-84ef-f98c6649813d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:20.391245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63cb9a-e90a-4020-84ef-f98c6649813d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:20.410533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 274/547] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:20.416195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:20.508364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:20.569316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8f81-e636-483a-9d78-1693a6a2c3bd None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:20.569650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8f81-e636-483a-9d78-1693a6a2c3bd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:20.569878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8f81-e636-483a-9d78-1693a6a2c3bd None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:20.571376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 275/548] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:20.579774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109897-807a-4e24-991b-238af58bc62f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:20.580091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109897-807a-4e24-991b-238af58bc62f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:20.580338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109897-807a-4e24-991b-238af58bc62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:20.590619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f9fda-f186-42d0-8251-dc2a7bbcc8d3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:20.609780 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ed109897-807a-4e24-991b-238af58bc62f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:20.610988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ed109897-807a-4e24-991b-238af58bc62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:20.655567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:20.656318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:20.656604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:20.656906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:20.667009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:20.668452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:20.681182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:20.694331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:20.695773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:20.696865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:20.701136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 274/549] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:20.710180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:20.740939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 276/550] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:20.759332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed109897-807a-4e24-991b-238af58bc62f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:20.883666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed109897-807a-4e24-991b-238af58bc62f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:20.922410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731a3f4-b7e9-4627-a97e-387b33b9bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:20.923274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731a3f4-b7e9-4627-a97e-387b33b9bc3b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:20.923564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731a3f4-b7e9-4627-a97e-387b33b9bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:20.923842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731a3f4-b7e9-4627-a97e-387b33b9bc3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:20.925994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b917aa7-4315-4060-a3d4-345dc705f10b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:20.943933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731a3f4-b7e9-4627-a97e-387b33b9bc3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:20.944542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2731a3f4-b7e9-4627-a97e-387b33b9bc3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:20.962538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:20.963494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:20.964513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:20.968946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 277/551] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:20.971080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731a3f4-b7e9-4627-a97e-387b33b9bc3b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:20.997199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:20.997882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:20.998169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:20.998450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:20.999299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:20.999875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:21.003621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:21.045190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 275/552] 10.222.0.79 () {56 vars in 1135 bytes} [Fri May 27 09:23:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:21.050981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:21.065188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:21.187050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731a3f4-b7e9-4627-a97e-387b33b9bc3b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:21.192959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc880840-c88f-4ff7-9987-4391faf0eec0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:21.231353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a963-93d5-4ba0-a6bc-926fba831874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:21.232016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a963-93d5-4ba0-a6bc-926fba831874 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.232308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a963-93d5-4ba0-a6bc-926fba831874 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.232593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a963-93d5-4ba0-a6bc-926fba831874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.268921 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:21.309139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8a963-93d5-4ba0-a6bc-926fba831874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:21.309139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8a963-93d5-4ba0-a6bc-926fba831874 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:21.314357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:21.315060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.315345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.315625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.316392 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:21.316700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:21.318161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:21.355363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 278/553] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:21.370182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:21.430687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 276/554] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:23:21.432329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a963-93d5-4ba0-a6bc-926fba831874 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:21.548009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:21.550250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:21.554664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2257f-7c25-4386-a029-4ba39b163eb0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:21.595275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a963-93d5-4ba0-a6bc-926fba831874 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:21.607645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1809f-29e0-4eea-aa49-b9a2a2522a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:21.608518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1809f-29e0-4eea-aa49-b9a2a2522a15 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.608851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1809f-29e0-4eea-aa49-b9a2a2522a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.609551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1809f-29e0-4eea-aa49-b9a2a2522a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.625093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1809f-29e0-4eea-aa49-b9a2a2522a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:21.626544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1809f-29e0-4eea-aa49-b9a2a2522a15 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:21.638613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:21.639635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.640661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.641135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-21a1809f-29e0-4eea-aa49-b9a2a2522a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:21.644616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:21.645723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 279/555] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9879-a070-4eee-8de2-06dbb75a7ca6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9879-a070-4eee-8de2-06dbb75a7ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9879-a070-4eee-8de2-06dbb75a7ca6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.650221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 280/556] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:21.654437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a256b-dc09-43f0-bb24-28b35b841301 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.654726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a256b-dc09-43f0-bb24-28b35b841301 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.655007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a256b-dc09-43f0-bb24-28b35b841301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.662338 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:21.664146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:21.672084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f38a256b-dc09-43f0-bb24-28b35b841301 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:21.673425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f38a256b-dc09-43f0-bb24-28b35b841301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:21.686645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:21.688660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:21.689611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:21.689611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:21.689611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:21.689611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:21.695136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 277/557] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:21.695136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:21.761375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 281/558] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:21.762674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a256b-dc09-43f0-bb24-28b35b841301 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:21.805658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e88ad-5a94-4dc7-a69f-7d3c435d241b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:21.824271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:21.842564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4fdd5-e684-403d-aa4f-3c36684b67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:21.843260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4fdd5-e684-403d-aa4f-3c36684b67fb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.843551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4fdd5-e684-403d-aa4f-3c36684b67fb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.843830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4fdd5-e684-403d-aa4f-3c36684b67fb None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.844552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4fdd5-e684-403d-aa4f-3c36684b67fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:21.844887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4fdd5-e684-403d-aa4f-3c36684b67fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:21.846256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4fdd5-e684-403d-aa4f-3c36684b67fb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:21.862352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 278/559] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:21.862352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af251829-fb38-4ca8-8135-75f4b15fe023 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.862352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af251829-fb38-4ca8-8135-75f4b15fe023 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.862352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af251829-fb38-4ca8-8135-75f4b15fe023 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.862352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 279/560] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:21.862352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af251829-fb38-4ca8-8135-75f4b15fe023 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:21.864300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:21.889907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a256b-dc09-43f0-bb24-28b35b841301 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:21.927806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:21.928472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:21.928760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:21.929070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:21.929792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:21.930100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:21.931490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:21.943120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 282/561] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:21.943931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:21.974735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af251829-fb38-4ca8-8135-75f4b15fe023 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.012217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577e1f8-6873-4381-b047-8f3079fc1d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.013043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e1f8-6873-4381-b047-8f3079fc1d8f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.013330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e1f8-6873-4381-b047-8f3079fc1d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.013607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e1f8-6873-4381-b047-8f3079fc1d8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.024478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577e1f8-6873-4381-b047-8f3079fc1d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2577e1f8-6873-4381-b047-8f3079fc1d8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:22.032118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:22.033093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:22.033942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 280/562] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:22.035528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a5fa-c8d6-4225-bbf3-43f0feadae44 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.035528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a5fa-c8d6-4225-bbf3-43f0feadae44 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.035528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754a5fa-c8d6-4225-bbf3-43f0feadae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.053092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b754a5fa-c8d6-4225-bbf3-43f0feadae44 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:22.054272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b754a5fa-c8d6-4225-bbf3-43f0feadae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:22.058386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695ddb5-d5ea-436c-bd8f-5dffee1a86e7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.086089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:22.096567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.097392 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.097680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.097955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.105813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.107269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.109683 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:22.122871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:22.123857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 283/563] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:23:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:22.125421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.131349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 281/564] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:22.132379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a5fa-c8d6-4225-bbf3-43f0feadae44 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.241277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056b83-9dfd-4499-b0f4-e94b091f274a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.246348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754a5fa-c8d6-4225-bbf3-43f0feadae44 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.283267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.283795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.284065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.284350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.284446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.284628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.284724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.285033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.285781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:22.286091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.287480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.295020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.296881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 282/565] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:22.300094 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.301742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:22.321373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:22.322702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:22.323593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 284/566] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:22.324078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.335638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:22.385400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:22.407868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbb59-f191-4bd0-9d71-80c48fa12a67 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.426425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7d65-cac3-4553-834b-938b1558edf2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.440478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.441169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.441452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.441729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.442555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:22.442949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.444281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.459549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986315bb-d11c-414e-ba2f-1fc8216e0848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.460332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986315bb-d11c-414e-ba2f-1fc8216e0848 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.460613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986315bb-d11c-414e-ba2f-1fc8216e0848 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.460920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986315bb-d11c-414e-ba2f-1fc8216e0848 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.461157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 283/567] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:22.462287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.475223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986315bb-d11c-414e-ba2f-1fc8216e0848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-986315bb-d11c-414e-ba2f-1fc8216e0848 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:22.482973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:22.484589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:22.485494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:22.489429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 285/568] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:22.490248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986315bb-d11c-414e-ba2f-1fc8216e0848 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.554382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:22.566337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56283c-9963-4ad5-96ae-f88c0aa84e8c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.588122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986315bb-d11c-414e-ba2f-1fc8216e0848 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.599574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1e16c-b5f5-4dd3-9ecb-1877597ffe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.600361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1e16c-b5f5-4dd3-9ecb-1877597ffe1c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.600671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1e16c-b5f5-4dd3-9ecb-1877597ffe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.600980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1e16c-b5f5-4dd3-9ecb-1877597ffe1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.605046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:22.611432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1e16c-b5f5-4dd3-9ecb-1877597ffe1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.612891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1e16c-b5f5-4dd3-9ecb-1877597ffe1c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.621827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.622484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.622767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.623041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.623819 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:22.624131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.625686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-49f1e16c-b5f5-4dd3-9ecb-1877597ffe1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:22.629772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:22.630806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:22.631757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:22.631757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:22.631757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:22.631757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:22.631757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 284/569] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:22.632459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb2dd-e728-4c67-9217-6457885055fa None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.632740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb2dd-e728-4c67-9217-6457885055fa None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.633039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb2dd-e728-4c67-9217-6457885055fa None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.634286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 285/570] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:22.634961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb2dd-e728-4c67-9217-6457885055fa None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.646034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 286/571] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:22.646034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.737160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb2dd-e728-4c67-9217-6457885055fa None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.738722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586fd4-7ac8-4327-b214-ef0b56a0842b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.769720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd44e2-9c37-40ef-a0bd-3d8f09bcefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.770568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd44e2-9c37-40ef-a0bd-3d8f09bcefb1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.770855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd44e2-9c37-40ef-a0bd-3d8f09bcefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.771124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd44e2-9c37-40ef-a0bd-3d8f09bcefb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.771855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.772518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.772806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.773116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.773856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:22.774171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.775581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.779222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:22.782124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd44e2-9c37-40ef-a0bd-3d8f09bcefb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.783867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd44e2-9c37-40ef-a0bd-3d8f09bcefb1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.784405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 287/572] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:22.789703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-79fd44e2-9c37-40ef-a0bd-3d8f09bcefb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:22.801825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:22.802755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:22.804120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:22.804120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:22.804120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:22.804120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:22.804120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 286/573] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:22.804507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a34bc8-e710-4b60-942a-2a2cced3870c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.804795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a34bc8-e710-4b60-942a-2a2cced3870c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.805100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a34bc8-e710-4b60-942a-2a2cced3870c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.821030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e2a34bc8-e710-4b60-942a-2a2cced3870c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:22.822200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e2a34bc8-e710-4b60-942a-2a2cced3870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:22.833811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:22.887922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 287/574] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:22.888664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a34bc8-e710-4b60-942a-2a2cced3870c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.897741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb389f-03cc-4d4b-a01d-2e6a845652e2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:22.931835 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:22.932492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:22.932769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:22.933082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:22.933798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:22.934106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:22.935468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:22.947072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 288/575] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:22.947864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:22.989011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a34bc8-e710-4b60-942a-2a2cced3870c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.010916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:23.023020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.023678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.023960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.024238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.025120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=113f9a9f11014b9ba3efe6781615d68b) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:23.025434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.026873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.032665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 288/576] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/role_assignments?user.id=113f9a9f11014b9ba3efe6781615d68b&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:23.033567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.050089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:23.053213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71332c-aedb-4168-b33a-59a4cc21194f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.090718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.091548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.091832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.092109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.103738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.105259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:23.123651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:23.125367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:23.126327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:23.126327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:23.126327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:23.126327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:23.126327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 289/577] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:23.126327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.158582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5ebf0-2f1a-4882-b052-874d9f3e71e6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.194534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.195208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.195489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.195774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.196530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:23.196817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.198229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.211131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 289/578] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:23.212234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.247337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aec3d7-a76d-4f28-96a8-addb43cc743a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.263284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:23.286224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ec307-8681-4a3f-b8f8-f0093bd2fd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.287025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ec307-8681-4a3f-b8f8-f0093bd2fd58 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.287310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ec307-8681-4a3f-b8f8-f0093bd2fd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.287707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ec307-8681-4a3f-b8f8-f0093bd2fd58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.302948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ec307-8681-4a3f-b8f8-f0093bd2fd58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-156ec307-8681-4a3f-b8f8-f0093bd2fd58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:23.310691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:23.311626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:23.313064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:23.317223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 290/579] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:23.318074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ec307-8681-4a3f-b8f8-f0093bd2fd58 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.328178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4360-e081-4a7b-a947-52321c0e3a1e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.335411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:23.364752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.365690 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.365993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.366275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.373961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.376110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:23.392320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:23.393655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 290/580] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:23.394613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.426741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ec307-8681-4a3f-b8f8-f0093bd2fd58 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.461006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.461680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.462227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.462514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.463228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:23.463536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.464970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.478038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 291/581] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:23.478693 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.513708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa418-e1d9-4203-8059-6c7709cae7fc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.521738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:23.551468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.552262 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.552544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.552820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.560070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.561564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.564526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:23.578425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:23.579550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 291/582] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:23.580462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.600624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198518a9-b685-4163-8d63-87544f1da740 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.634904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.635569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.635852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.636131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.636894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:23.637208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.638569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.646255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 292/583] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:23.647035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.692301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421228f-eaed-431f-bb27-075044fb57bc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.727323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.728356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.728794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.729378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.730224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:23.730540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.731979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.752287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07601f59-ff32-4ea3-8ebd-8be5dca60093 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.752745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 292/584] 10.222.0.79 () {56 vars in 1137 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:23.753669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.779387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:23.793231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.794049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.794335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.794615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.796641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:23.803645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.805189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:23.820407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:23.821617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 293/585] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:23.822788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.866964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095528c-0b95-4135-8e7a-88e31a34a80c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.902589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.903328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.903616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.903898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.904798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:23.905136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.906583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.918721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 293/586] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:23.919420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:23.930620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbd8ee-149c-4ec2-8420-22554700e083 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:23.965103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:23.965821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:23.966099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:23.966372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:23.976815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:23.978276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:23.995985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:23.996936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:24.003447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:24.003447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:24.003447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:24.003447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:24.003447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 294/587] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:24.003447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.017389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:24.035541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54d134-b6ea-4c24-aaa8-41d26e1c669b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.051149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:24.070590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.071380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.071666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.071950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.083580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.085048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:24.102525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:24.103522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:24.104441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:24.104441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:24.104441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:24.104441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:24.104441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 294/588] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:24.104754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.116540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4183-6300-4b73-95b8-072a15d67eba None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.151362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.151784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.152070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.152330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.153264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:24.153493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.154928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.173508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 295/589] 10.222.0.79 () {56 vars in 1137 bytes} [Fri May 27 09:23:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:24.174324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.235271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db1cd-8c69-4417-a357-309d8539dbbc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.269932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb320f8-cd4d-4fbe-bc28-fc3d9d0761b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.270821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb320f8-cd4d-4fbe-bc28-fc3d9d0761b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.271107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb320f8-cd4d-4fbe-bc28-fc3d9d0761b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.271383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb320f8-cd4d-4fbe-bc28-fc3d9d0761b9 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/742917921213432a8ec7853ccf988fdf/roles/d8b62a0f71124aa1bd3c62e2923db913` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.275423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:24.288729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb320f8-cd4d-4fbe-bc28-fc3d9d0761b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=742917921213432a8ec7853ccf988fdf, role_id=d8b62a0f71124aa1bd3c62e2923db913)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.290238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb320f8-cd4d-4fbe-bc28-fc3d9d0761b9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.304520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8df71-6540-467a-9a78-2fb93c6d399b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.307651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 295/590] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:23:24 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/742917921213432a8ec7853ccf988fdf/roles/d8b62a0f71124aa1bd3c62e2923db913 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:24.308103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:24.308223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb320f8-cd4d-4fbe-bc28-fc3d9d0761b9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.351618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.352363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.352666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.353022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.353752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:24.354059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.355502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.373335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 296/591] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:24.374356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.468793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb320f8-cd4d-4fbe-bc28-fc3d9d0761b9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.490555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141a88e-338b-4f5a-94bf-6553148c9a42 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.519317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.521089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.521089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.521089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.521739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:24.521923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.523381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.536193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 296/592] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:24.537435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.547226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.548039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.548325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.548607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.560478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.562133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:24.581585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:24.582573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:24.583558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:24.583558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:24.583558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:24.583558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:24.587688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 297/593] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:24.588564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.600814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:24.613562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:24.679519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e2e5-ae03-4906-acee-7f3633182901 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.708454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faa236-2469-48e1-9459-be68b7d41e9a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.724606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.726030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.726414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.726939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.737910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.740295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.752288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.753376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.753862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.754338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:24.761354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:24.762375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:23:24.763818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:24.765093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.766791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.767404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 297/594] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:24.768315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:24.784157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:24.785197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:24.786116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:24.786116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:24.786116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:24.786116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:24.786116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:24.786116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:24.786116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:24.786116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:24.792807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 298/595] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:24.793974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.881560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:24.900026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff624-5c95-4c7e-b7bc-589685092230 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.910150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:24.912150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d910c91-fb9b-408e-b0e7-63f47178030d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:24.946429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.947608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.948083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.948557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.949377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:24.949750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.951182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.953124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:24.954056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:24.954532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:24.955009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:24.956027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:24.956527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:24.958174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:24.965210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 298/596] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:24.969760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:24.984797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 299/597] 10.222.0.79 () {56 vars in 1139 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:24.986284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.104145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9572d2f-aec4-4578-8ac1-857637f3d48f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.106399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e8aec-8a6b-47f0-8e3f-b86e059f6781 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.144727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.145863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.146159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.146437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.148723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:25.151375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.152303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.152791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.153301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.155632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:25.156756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:25.157407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:25.158777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:25.158899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:25.176086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:25.177094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:25.178369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:25.178369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:25.178369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:25.178369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:25.178369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:25.178369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:25.178369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:25.178369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:25.179114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 299/599] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:25.180244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.180929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 300/599] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:25.181982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.211043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:25.289450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb020a6-ca0d-46db-84dd-84d5cbb9d25e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.298727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf0c2-051b-4943-bae5-60117ab0eafc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.323800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.324603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.324924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.325194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.336096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:25.337825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:25.340362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9e637-1de2-4d74-ab44-11b5fef45c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.341154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e637-1de2-4d74-ab44-11b5fef45c39 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.341509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e637-1de2-4d74-ab44-11b5fef45c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.341863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e637-1de2-4d74-ab44-11b5fef45c39 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.342716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e637-1de2-4d74-ab44-11b5fef45c39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:25.343123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e637-1de2-4d74-ab44-11b5fef45c39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:25.344629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e637-1de2-4d74-ab44-11b5fef45c39 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:25.355395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:25.356279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:25.365797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:25.365797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:25.365797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:25.365797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:25.365797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 300/600] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:25.366083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 301/601] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:25.366491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.366575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73482-5abc-4abd-af76-ea91a966b0b5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.366575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73482-5abc-4abd-af76-ea91a966b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.366575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73482-5abc-4abd-af76-ea91a966b0b5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.366575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 302/602] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:25.366575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f73482-5abc-4abd-af76-ea91a966b0b5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.425944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:25.450405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:25.474262 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138e6d-3a82-41bf-b553-7ee8bdd8942e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.475736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f73482-5abc-4abd-af76-ea91a966b0b5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.510086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39136c-f57a-4ab6-844b-1c9414bcbd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.511072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39136c-f57a-4ab6-844b-1c9414bcbd72 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.511360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39136c-f57a-4ab6-844b-1c9414bcbd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.511736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39136c-f57a-4ab6-844b-1c9414bcbd72 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/fe6a8bf853cd4b60916375d9ebbd468f/roles/d8b62a0f71124aa1bd3c62e2923db913` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.512167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f89fd-bac6-4ac1-9fd3-8d680a49bc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.512845 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f89fd-bac6-4ac1-9fd3-8d680a49bc2e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.513137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f89fd-bac6-4ac1-9fd3-8d680a49bc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.513415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f89fd-bac6-4ac1-9fd3-8d680a49bc2e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.514134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f89fd-bac6-4ac1-9fd3-8d680a49bc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:25.514444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f89fd-bac6-4ac1-9fd3-8d680a49bc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:25.516369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f89fd-bac6-4ac1-9fd3-8d680a49bc2e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:25.528151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 303/603] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:25.529199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39136c-f57a-4ab6-844b-1c9414bcbd72 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=fe6a8bf853cd4b60916375d9ebbd468f, role_id=d8b62a0f71124aa1bd3c62e2923db913)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:25.529454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd476-2925-4820-bd29-626273b53cc3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.529740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd476-2925-4820-bd29-626273b53cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.530020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd476-2925-4820-bd29-626273b53cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.531455 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39136c-f57a-4ab6-844b-1c9414bcbd72 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:25.546720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 301/604] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:23:25 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/fe6a8bf853cd4b60916375d9ebbd468f/roles/d8b62a0f71124aa1bd3c62e2923db913 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:25.547766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39136c-f57a-4ab6-844b-1c9414bcbd72 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.548416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a9bbd476-2925-4820-bd29-626273b53cc3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:25.549834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a9bbd476-2925-4820-bd29-626273b53cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:25.640397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 304/605] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:25.641687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd476-2925-4820-bd29-626273b53cc3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.686648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39136c-f57a-4ab6-844b-1c9414bcbd72 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.702894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:25.717020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:25.727058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba444-5620-4810-9f0f-6e728b11ed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.728032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba444-5620-4810-9f0f-6e728b11ed93 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.728324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba444-5620-4810-9f0f-6e728b11ed93 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.728606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba444-5620-4810-9f0f-6e728b11ed93 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/2b11f7990b364f5281def98b941e1e00/roles/d8b62a0f71124aa1bd3c62e2923db913` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.744665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba444-5620-4810-9f0f-6e728b11ed93 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=2b11f7990b364f5281def98b941e1e00, role_id=d8b62a0f71124aa1bd3c62e2923db913)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:25.746160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba444-5620-4810-9f0f-6e728b11ed93 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:25.764151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 302/606] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:23:25 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/2b11f7990b364f5281def98b941e1e00/roles/d8b62a0f71124aa1bd3c62e2923db913 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:25.765510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba444-5620-4810-9f0f-6e728b11ed93 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.779711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd476-2925-4820-bd29-626273b53cc3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.838522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.840177 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.840465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.840748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.860763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:25.862288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:25.893184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:25.894121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:25.895025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:25.895025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:25.895025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:25.895025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:25.895025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:25.895025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:25.895025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:25.895025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:25.905812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 305/607] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:25.911799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:25.915416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba444-5620-4810-9f0f-6e728b11ed93 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:25.958060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c552b5-5a19-4d50-a215-f977baea1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:25.958882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c552b5-5a19-4d50-a215-f977baea1c1e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:25.959161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c552b5-5a19-4d50-a215-f977baea1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:25.959438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c552b5-5a19-4d50-a215-f977baea1c1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:25.975987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c552b5-5a19-4d50-a215-f977baea1c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-68c552b5-5a19-4d50-a215-f977baea1c1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:25.984761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:25.985756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:25.986625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 303/608] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:25.993623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c552b5-5a19-4d50-a215-f977baea1c1e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:26.037834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:26.055370 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a2f62-cf92-4bc0-8c2e-c9cc0ebf51be None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:26.069189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:26.094691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:26.095368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.095657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:26.095940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:26.096740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:26.097101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:26.102316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:26.107927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c552b5-5a19-4d50-a215-f977baea1c1e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:26.124012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 306/609] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:26.129187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:26.154526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:26.155133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.155422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:26.156278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:26.157064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:26.157374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:26.158744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:26.185206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 304/610] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:26.186141 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:26.247544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cdd6b-b2ff-4fcb-b837-c12e3750fd43 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:26.314101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38117631-9a5e-4cbd-ba5a-d5d618de0db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:26.315302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38117631-9a5e-4cbd-ba5a-d5d618de0db5 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.315787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38117631-9a5e-4cbd-ba5a-d5d618de0db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:26.316262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38117631-9a5e-4cbd-ba5a-d5d618de0db5 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/ebee38389afb4270b18c6a14c7a4e302/roles/d8b62a0f71124aa1bd3c62e2923db913` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:26.331816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38117631-9a5e-4cbd-ba5a-d5d618de0db5 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=ebee38389afb4270b18c6a14c7a4e302, role_id=d8b62a0f71124aa1bd3c62e2923db913)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:26.333750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38117631-9a5e-4cbd-ba5a-d5d618de0db5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:26.355265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 307/611] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:23:26 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/ebee38389afb4270b18c6a14c7a4e302/roles/d8b62a0f71124aa1bd3c62e2923db913 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:26.366174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d156-3b37-4ad7-a989-001b56a73ae5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:26.380104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:26.413875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5004f-6a7f-4087-b0f3-e3decbf4b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:26.415166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5004f-6a7f-4087-b0f3-e3decbf4b398 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.415687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5004f-6a7f-4087-b0f3-e3decbf4b398 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:26.416250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5004f-6a7f-4087-b0f3-e3decbf4b398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:26.434339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5004f-6a7f-4087-b0f3-e3decbf4b398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:26.436311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5004f-6a7f-4087-b0f3-e3decbf4b398 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7aa5004f-6a7f-4087-b0f3-e3decbf4b398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:26.462205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:26.463225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:26.464135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:26.464135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:26.464135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:26.464135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:26.466699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 305/612] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:26.472559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38117631-9a5e-4cbd-ba5a-d5d618de0db5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:26.491380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:26.595598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38117631-9a5e-4cbd-ba5a-d5d618de0db5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:26.626852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a45d1-c2db-4e21-8de7-637af87af695 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.627195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a45d1-c2db-4e21-8de7-637af87af695 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:26.627419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a45d1-c2db-4e21-8de7-637af87af695 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:26.629045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 306/613] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:26.634397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:26.635381 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.635878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:26.636185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8faaa-db68-40eb-979c-e05e4e8d7459 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.636483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8faaa-db68-40eb-979c-e05e4e8d7459 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:26.636770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8faaa-db68-40eb-979c-e05e4e8d7459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:26.637021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:26.638021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:26.638613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:26.640798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:26.653761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 308/614] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:26.656485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-dcc8faaa-db68-40eb-979c-e05e4e8d7459 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:26.657765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dcc8faaa-db68-40eb-979c-e05e4e8d7459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:26.659788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:26.742646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 307/615] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:26.745494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:26.772597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8faaa-db68-40eb-979c-e05e4e8d7459 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:26.773125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435b855-6fbe-4ca6-8bc5-8bdbd6b6af5a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:26.845308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:26.846484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.846971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:26.847471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:26.866045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:26.867829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:26.873746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:26.894864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:26.895884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:26.896888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 309/616] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:26.901565 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:26.922917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8faaa-db68-40eb-979c-e05e4e8d7459 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:26.998136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b35a-81fa-4854-8981-65ec8ff4e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:26.999477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b35a-81fa-4854-8981-65ec8ff4e1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:26.999990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b35a-81fa-4854-8981-65ec8ff4e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:27.000472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b35a-81fa-4854-8981-65ec8ff4e1e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:27.012142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0b35a-81fa-4854-8981-65ec8ff4e1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b6d0b35a-81fa-4854-8981-65ec8ff4e1e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:27.021505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:27.022527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:27.023396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:27.026540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 308/617] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:27.033206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b35a-81fa-4854-8981-65ec8ff4e1e9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:27.053531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43052-c52f-449a-957d-d1884e88fa0e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:27.119442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:27.120134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:27.120412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:27.120690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:27.121560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:27.121871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:27.123321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:27.125408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:27.145235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 310/618] 10.222.0.79 () {56 vars in 1135 bytes} [Fri May 27 09:23:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:27.148259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:27.237320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b35a-81fa-4854-8981-65ec8ff4e1e9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:27.309188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:27.309866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:27.310149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:27.310423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:27.311176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:27.311479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:27.313124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:27.322627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65584d-69b6-459c-92df-a692cc98214f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:27.328196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 309/619] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:27.333628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:27.339279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:27.394724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:27.395523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:27.395802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:27.396074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:27.415419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:27.418019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:27.451634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:27.452654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:27.453621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:27.453621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:27.453621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:27.453621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:27.455228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 311/620] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:27.459933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:27.491609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2e34a-dbd4-486b-841c-a6d49b2db0cf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:27.542449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:27.557459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:27.558193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:27.558470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:27.558746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:27.577885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:27.583963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:27.609764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:27.610721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:27.611629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:27.611629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:27.611629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:27.611629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:27.611629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 310/621] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:27.621170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:27.639253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac5965-c3b8-49e3-9e96-afeb612003a5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:27.700696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:27.701393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:27.701674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:27.701955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:27.702703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:27.703012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:27.704384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:27.729018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 312/622] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:27.729521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:27.734714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:27.789114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274b9b-8028-43de-a985-33400c71dc1e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:27.828319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:27.829126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:27.829418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:27.829693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:27.830416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:27.830724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:27.832089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:27.856670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 311/623] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:27.866472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:27.942886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6298d-f8e6-4e36-8eee-adf57b5597f3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:27.949437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:28.006520 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598c66-d29c-46d2-9e3c-ad8d9ff574d1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:28.040867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:28.044914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:28.045753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.047222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.047504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.048843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:28.049662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.049939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.050214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.065561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:28.067060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:28.068804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:28.070389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:28.094385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:28.095384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:28.096998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 312/624] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:23:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:28.103945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:28.104872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:28.106959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 313/625] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:28.108108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:28.111907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:28.281336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7ed4-6e2d-4e99-bf95-c4eeb665e925 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:28.287802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109de22-8807-4578-89af-a841967b0b3b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:28.329716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c90f-8355-4a29-97ed-231194a68a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:28.329931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d4214-ba2b-4205-83cf-8d766edb861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:28.330386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d4214-ba2b-4205-83cf-8d766edb861b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.330495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c90f-8355-4a29-97ed-231194a68a0e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.330654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c90f-8355-4a29-97ed-231194a68a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.330755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d4214-ba2b-4205-83cf-8d766edb861b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.330935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c90f-8355-4a29-97ed-231194a68a0e None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.331032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d4214-ba2b-4205-83cf-8d766edb861b None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.331721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d4214-ba2b-4205-83cf-8d766edb861b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:28.331828 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3c90f-8355-4a29-97ed-231194a68a0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:28.332032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d4214-ba2b-4205-83cf-8d766edb861b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:28.332212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3c90f-8355-4a29-97ed-231194a68a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:28.333506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d4214-ba2b-4205-83cf-8d766edb861b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:28.333614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3c90f-8355-4a29-97ed-231194a68a0e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:28.346969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 314/626] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:28.348227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1016-cc09-426c-ab09-8cdbdbe15cae None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.348516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1016-cc09-426c-ab09-8cdbdbe15cae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.348796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1016-cc09-426c-ab09-8cdbdbe15cae None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.350376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 315/627] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:28.357915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f1016-cc09-426c-ab09-8cdbdbe15cae None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:28.363100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 313/628] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:23:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:28.364498 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9315-cc31-4c47-af01-1bb1e1258ca4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.364790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9315-cc31-4c47-af01-1bb1e1258ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.365098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9315-cc31-4c47-af01-1bb1e1258ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.385813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-189d9315-cc31-4c47-af01-1bb1e1258ca4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:28.387338 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-189d9315-cc31-4c47-af01-1bb1e1258ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:28.393703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:28.420671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:28.472854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 314/629] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:28.472854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d9315-cc31-4c47-af01-1bb1e1258ca4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:28.509262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f1016-cc09-426c-ab09-8cdbdbe15cae None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:28.545839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fbdf3-01b9-4a64-9413-cd0733430ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:28.547958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fbdf3-01b9-4a64-9413-cd0733430ce4 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.548243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fbdf3-01b9-4a64-9413-cd0733430ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.548518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fbdf3-01b9-4a64-9413-cd0733430ce4 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/113f9a9f11014b9ba3efe6781615d68b/roles/d8b62a0f71124aa1bd3c62e2923db913` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.564949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fbdf3-01b9-4a64-9413-cd0733430ce4 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=113f9a9f11014b9ba3efe6781615d68b, role_id=d8b62a0f71124aa1bd3c62e2923db913)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:28.566419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fbdf3-01b9-4a64-9413-cd0733430ce4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:28.593405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 316/630] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:23:28 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/113f9a9f11014b9ba3efe6781615d68b/roles/d8b62a0f71124aa1bd3c62e2923db913 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:28.593631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d9315-cc31-4c47-af01-1bb1e1258ca4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:28.594048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f931ad-5d34-4712-ac56-a434c8a337db None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.594048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f931ad-5d34-4712-ac56-a434c8a337db None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.594048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f931ad-5d34-4712-ac56-a434c8a337db None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.594048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 317/631] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:28.594048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f931ad-5d34-4712-ac56-a434c8a337db None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:28.641826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd93b-37ef-491f-8983-4d4e4bb73606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:28.642580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd93b-37ef-491f-8983-4d4e4bb73606 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.642992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd93b-37ef-491f-8983-4d4e4bb73606 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.643834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bd93b-37ef-491f-8983-4d4e4bb73606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.685991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:28.697951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:28.720109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f931ad-5d34-4712-ac56-a434c8a337db None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:28.749434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd93b-37ef-491f-8983-4d4e4bb73606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:28.750976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bd93b-37ef-491f-8983-4d4e4bb73606 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:28.777675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad057db-fa2f-442c-894c-1ad91de9c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:28.779598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad057db-fa2f-442c-894c-1ad91de9c209 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.780465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad057db-fa2f-442c-894c-1ad91de9c209 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.781502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad057db-fa2f-442c-894c-1ad91de9c209 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.798208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad057db-fa2f-442c-894c-1ad91de9c209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8ad057db-fa2f-442c-894c-1ad91de9c209 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:28.808150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:28.809166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:28.810171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:28.810844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 318/632] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:28.811627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e811-b90f-429d-96c2-4964c46f8b94 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:28.811921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e811-b90f-429d-96c2-4964c46f8b94 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:28.812203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e811-b90f-429d-96c2-4964c46f8b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:28.831611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4632e811-b90f-429d-96c2-4964c46f8b94 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:28.833185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4632e811-b90f-429d-96c2-4964c46f8b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:28.892326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 315/633] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:28.893240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd93b-37ef-491f-8983-4d4e4bb73606 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:28.928461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 319/634] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:28.932867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e811-b90f-429d-96c2-4964c46f8b94 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:28.986311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.029195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bd93b-37ef-491f-8983-4d4e4bb73606 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.031807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.072144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e811-b90f-429d-96c2-4964c46f8b94 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.076217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.076950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.077268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.078121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.079020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:29.079335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.080716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.091965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 316/635] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:29.092765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.114357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a4e95-1663-4d94-8459-08a974cf856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.115154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4e95-1663-4d94-8459-08a974cf856a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.115434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4e95-1663-4d94-8459-08a974cf856a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.115710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4e95-1663-4d94-8459-08a974cf856a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.127788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a4e95-1663-4d94-8459-08a974cf856a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.129272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a4e95-1663-4d94-8459-08a974cf856a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b04a4e95-1663-4d94-8459-08a974cf856a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:29.147902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:29.148813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:29.149787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:29.149787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:29.149787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:29.149787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:29.149787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 320/636] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:29.150642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707a583-4455-4cf1-896f-262be33799b7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.150642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707a583-4455-4cf1-896f-262be33799b7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.150815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707a583-4455-4cf1-896f-262be33799b7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.156147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 321/637] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:29.156803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707a583-4455-4cf1-896f-262be33799b7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.209216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83ff72-258c-492c-be17-74f8c917f027 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.233922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.243813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b681-a676-49bf-bd1a-89c41ab9a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.244723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b681-a676-49bf-bd1a-89c41ab9a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.245032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b681-a676-49bf-bd1a-89c41ab9a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.245446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b681-a676-49bf-bd1a-89c41ab9a8c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.256490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168b681-a676-49bf-bd1a-89c41ab9a8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:29.264179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707a583-4455-4cf1-896f-262be33799b7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-9168b681-a676-49bf-bd1a-89c41ab9a8c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:29.264626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:29.266160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:29.267048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 317/638] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:29.267804 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b681-a676-49bf-bd1a-89c41ab9a8c8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.287020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.310183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b2121-7fa7-45e6-91ce-341e5eb32783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.310989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2121-7fa7-45e6-91ce-341e5eb32783 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.311266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2121-7fa7-45e6-91ce-341e5eb32783 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.311545 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2121-7fa7-45e6-91ce-341e5eb32783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.322896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b2121-7fa7-45e6-91ce-341e5eb32783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.324348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b2121-7fa7-45e6-91ce-341e5eb32783 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-153b2121-7fa7-45e6-91ce-341e5eb32783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:29.342332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:29.343567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:29.344499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:29.344499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:29.344499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:29.344499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:29.344499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 322/639] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:29.345244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4551-bdfb-49eb-8126-2dfeb745cc32 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.345534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4551-bdfb-49eb-8126-2dfeb745cc32 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.345815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4551-bdfb-49eb-8126-2dfeb745cc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.364400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7c0f4551-bdfb-49eb-8126-2dfeb745cc32 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:29.365825 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7c0f4551-bdfb-49eb-8126-2dfeb745cc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:29.386013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b681-a676-49bf-bd1a-89c41ab9a8c8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.419799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.420385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.420668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.421512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.422240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:29.422547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.423912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.440209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 318/640] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:29.440209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.448880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 323/641] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:29.448880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4551-bdfb-49eb-8126-2dfeb745cc32 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.490682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.545234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96c5d5-1d50-48ca-872a-e203fdf7d119 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.563834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.567635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4551-bdfb-49eb-8126-2dfeb745cc32 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.581606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.582280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.582565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.582844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.583581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:29.583888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.585321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.593731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 319/642] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:29.594522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.611898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.613278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.613816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.614301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.615231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:29.616161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.618058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.634875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 324/643] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:29.634875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.695663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f28d-837a-41fa-a0c7-bbe06dd15c3b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.704763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.735477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.736290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.736589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.736871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.742978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d41e-7554-484b-894d-cd21ddbb8cd9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.744121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.745594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:29.759576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:29.760547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:29.761514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 320/644] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:29.762026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.785601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a888-dd53-442f-9daf-49ba39a5bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.786518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a888-dd53-442f-9daf-49ba39a5bc22 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.786804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a888-dd53-442f-9daf-49ba39a5bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.787083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a888-dd53-442f-9daf-49ba39a5bc22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.799335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2a888-dd53-442f-9daf-49ba39a5bc22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6ee2a888-dd53-442f-9daf-49ba39a5bc22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:29.807050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:29.808038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 325/645] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:29.813785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a888-dd53-442f-9daf-49ba39a5bc22 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.831949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.876596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8d6b-098b-46b7-8486-40d7a5019926 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.912202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.913264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.913548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.913824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.918280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a888-dd53-442f-9daf-49ba39a5bc22 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:29.923853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.925349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:29.943730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:29.944648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:29.945596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:29.945596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:29.945596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:29.945596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:29.945596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 321/646] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:29.945935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:29.957903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:29.958706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:29.958979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:29.959256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:29.967284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:29.968777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:29.973179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:29.983369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:29.984351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 326/647] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:29.985351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.060111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332379a-83c0-4fdf-8095-c2a734d4c6cb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.073358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:30.098078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.099086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79f1f-c341-4ab3-acb3-c17a802ed513 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.099204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.099701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.100182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.102041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:30.102385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.103855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.121219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 322/648] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:30.121219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.142598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.143278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.143566 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.143849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.144588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:30.145110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.146302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.154588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 327/649] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:30.159970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.206281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:30.227123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b99ec9-8eb5-43b3-b585-344549ecd80b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.262607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.263271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.263550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.263825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.264537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:30.264924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.266127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c0251-fe0e-48d2-902f-043eaa8cd7db None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.266313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.278617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 323/650] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:30.279504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.314221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.314902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.315183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.315446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.316276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:30.316587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.318054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.328311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:30.337399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 328/651] 10.222.0.79 () {56 vars in 1137 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:30.338233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.391511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ce4e7-2449-468d-8b9e-937d536529b4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.428130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.429216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.429760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.430240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.431220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=742917921213432a8ec7853ccf988fdf) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:30.431791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.433508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.434981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592febe9-7e12-425a-bbab-c41adca74f59 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.440795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 324/652] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/role_assignments?user.id=742917921213432a8ec7853ccf988fdf&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:30.441777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.452948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:30.484902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.485655 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.485933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.486204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.498333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.500409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:30.520690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:30.521915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:30.522980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:30.522980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:30.522980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:30.522980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:30.526809 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 329/653] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:30.527755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.586740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:30.594305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357d6d-472d-4adb-8943-8786dd60005f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.642906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.643862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.643992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.644154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.654932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.656571 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.661104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a53a-3ee1-4abb-b806-6fa0a755e207 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:30.672261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:30.673329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:30.674287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 325/654] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:30.674935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.718111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b106362-99cb-4bf0-a825-51a3aa97b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.718796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b106362-99cb-4bf0-a825-51a3aa97b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.719075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b106362-99cb-4bf0-a825-51a3aa97b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.719350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b106362-99cb-4bf0-a825-51a3aa97b0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.754953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:30.802505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbcd2e-9d98-4c8a-b309-eeec2dc968a2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.807744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b106362-99cb-4bf0-a825-51a3aa97b0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.809253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b106362-99cb-4bf0-a825-51a3aa97b0d7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.838845 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:30.839516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.839805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.840082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.840937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:30.841245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:30.842812 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:30.856503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 326/655] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:30.857600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.862564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:30.918854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 330/656] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:30.924996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2eeda-4cd5-4951-8b2d-9810e6ff4d0e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:30.925514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2eeda-4cd5-4951-8b2d-9810e6ff4d0e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:30.925625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2eeda-4cd5-4951-8b2d-9810e6ff4d0e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:30.928878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 331/657] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:30.928878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2eeda-4cd5-4951-8b2d-9810e6ff4d0e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:30.966182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fd08-fdbe-4cc7-a077-b3060b0bfe5c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:30.989962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.002616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.003384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.003740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.004081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.004951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:31.005359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:31.006744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:31.028724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 327/658] 10.222.0.79 () {56 vars in 1137 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:31.028724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.039826 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2eeda-4cd5-4951-8b2d-9810e6ff4d0e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.075594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aee68f-82f7-485e-a65f-5fb9c2825b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.076477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aee68f-82f7-485e-a65f-5fb9c2825b1a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.076791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aee68f-82f7-485e-a65f-5fb9c2825b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.077657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aee68f-82f7-485e-a65f-5fb9c2825b1a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.085408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aee68f-82f7-485e-a65f-5fb9c2825b1a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:31.087127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aee68f-82f7-485e-a65f-5fb9c2825b1a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f4aee68f-82f7-485e-a65f-5fb9c2825b1a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:31.102463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:31.103440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:31.105109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 332/659] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:31.109440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370334-4cbb-42c0-bbc0-bb40a11b8790 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.109733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370334-4cbb-42c0-bbc0-bb40a11b8790 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.110019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370334-4cbb-42c0-bbc0-bb40a11b8790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.126758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a4370334-4cbb-42c0-bbc0-bb40a11b8790 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:31.127966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a4370334-4cbb-42c0-bbc0-bb40a11b8790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:31.130977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.132332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde5537-5bd8-461d-9b01-6309544bad02 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.166441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.167240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.167524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.167800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.178106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:31.179577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:31.196724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:31.197677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:31.198596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:31.198596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:31.198596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:31.198596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:31.198596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 328/660] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:31.198876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.216858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 333/661] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:31.216858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4370334-4cbb-42c0-bbc0-bb40a11b8790 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.243640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.317806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d1056-b013-41f4-8185-f78cafb0d1d5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.318061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4370334-4cbb-42c0-bbc0-bb40a11b8790 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.353555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3d26f-cbcc-4ff2-a7a9-e4e954c08bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.354145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.354263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3d26f-cbcc-4ff2-a7a9-e4e954c08bbc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.354474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3d26f-cbcc-4ff2-a7a9-e4e954c08bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.354752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3d26f-cbcc-4ff2-a7a9-e4e954c08bbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.354847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.355090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.355508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.356350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:31.356722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:31.358197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:31.369019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.379167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 334/662] 10.222.0.79 () {56 vars in 1139 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:31.384576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.424706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3d26f-cbcc-4ff2-a7a9-e4e954c08bbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:31.426179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3d26f-cbcc-4ff2-a7a9-e4e954c08bbc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:31.458713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.488141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137ae32-a80c-4382-b268-0108d040e56e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.523300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 329/663] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:31.524144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3d26f-cbcc-4ff2-a7a9-e4e954c08bbc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.524422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.525304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.525773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.526342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.527069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:31.527381 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:31.528760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:31.541293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 335/664] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:31.542102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.606585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.631500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3d26f-cbcc-4ff2-a7a9-e4e954c08bbc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.655020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065ae92-00c8-4d69-9cc0-615010bca1b2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.667099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26296d-03c2-4f4a-9ce1-5b66e3290a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.667888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26296d-03c2-4f4a-9ce1-5b66e3290a38 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.668168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26296d-03c2-4f4a-9ce1-5b66e3290a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.668439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26296d-03c2-4f4a-9ce1-5b66e3290a38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.670381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.681809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26296d-03c2-4f4a-9ce1-5b66e3290a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1b26296d-03c2-4f4a-9ce1-5b66e3290a38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:31.689757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:31.690788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:31.691641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 330/665] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:31.692356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26296d-03c2-4f4a-9ce1-5b66e3290a38 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.695352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6b620-9061-43ff-a95f-145ca8b6ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.697257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b620-9061-43ff-a95f-145ca8b6ee39 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.697549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b620-9061-43ff-a95f-145ca8b6ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.697889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b620-9061-43ff-a95f-145ca8b6ee39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.769225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6b620-9061-43ff-a95f-145ca8b6ee39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:31.770697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6b620-9061-43ff-a95f-145ca8b6ee39 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:31.801323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26296d-03c2-4f4a-9ce1-5b66e3290a38 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.828752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.837528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:31.838328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:31.838611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:31.838888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:31.850404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:31.851848 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:31.870112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:31.871179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:31.872133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:31.872133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:31.872133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:31.872133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:31.872133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 331/666] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:31.872133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.881942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 336/667] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:31.882966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6b620-9061-43ff-a95f-145ca8b6ee39 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:31.918361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:31.978062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8fcf6-10be-4a78-b72f-b8ec08050d88 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:31.986305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6b620-9061-43ff-a95f-145ca8b6ee39 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.015900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.016822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.017246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.017529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.019454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.020115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.020396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.020672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.021442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:32.021747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.023122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.025585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.027171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.031426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 337/668] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:32.032213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:32.043034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:32.044148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:32.045279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:32.045279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:32.045279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:32.045279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:32.045279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:32.045279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:32.045279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:32.045279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:32.047587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 332/669] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:32.048512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.062991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:32.147182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e79a6-73e3-47a6-a9a2-0ae86b9adeac None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.151237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f249c7-92dc-4cef-9bf4-c656ebb0a643 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.159603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:32.184882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.185558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.185842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.186124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.186874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:32.187183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.188583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.189228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.190214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.190497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.191210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.204796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 338/670] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:32.204796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.207858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.209372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:32.228009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:32.228973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:32.229887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:32.229887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:32.229887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:32.229887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:32.229887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 333/671] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:32.230820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.303880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:32.324795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b18f1-4185-4c1c-91b0-1b4ca41a1dae None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.339907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b976b93-3770-4a4a-8288-b2c58b192e38 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.362820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.363620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.363903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.364203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.374768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.376291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.377365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.378137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.378426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.378953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.379610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:32.379920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.381423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.393425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 334/672] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:32.394052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:32.395390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:32.396320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:32.397357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:32.397357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:32.397357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:32.397357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:32.397357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 339/673] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:32.397891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.419901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:32.502013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65ce36-35e3-4f13-86da-0890dc393f71 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.538962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.539778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.540057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.540330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.548064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.549562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:32.564776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:32.565777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:32.566701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 335/674] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:32.567193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.639571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e6367-ed83-4a84-bc6a-67eb64a5b390 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.662697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:32.677714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:32.684303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.684799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaddde2-a242-4e5d-a1b8-4a7972d317ba None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.685018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.685303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.685584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.686314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:32.686764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.688141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.704575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 340/675] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:32.704575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.725325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.725978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.726260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.726537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.727358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=fe6a8bf853cd4b60916375d9ebbd468f) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:32.727672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.729113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.744863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 336/676] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/role_assignments?user.id=fe6a8bf853cd4b60916375d9ebbd468f&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:32.744863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.823132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3627d-7e96-4a11-9d14-e0fab3d3e0cb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.861705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.862386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.862675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.863028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.863931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:32.864236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.865659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.867561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad67484-6a99-4e86-9a2f-eb5438255380 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:32.880153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 341/677] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:32.881911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.922221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c681e-e296-46fd-bcfc-f701e61429d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:32.922732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c681e-e296-46fd-bcfc-f701e61429d3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.923012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c681e-e296-46fd-bcfc-f701e61429d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.923285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c681e-e296-46fd-bcfc-f701e61429d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.924075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c681e-e296-46fd-bcfc-f701e61429d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:32.924387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c681e-e296-46fd-bcfc-f701e61429d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:32.926244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c681e-e296-46fd-bcfc-f701e61429d3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:32.940551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 337/678] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:32.941400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:32.942840 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399a1e1-fe97-4440-9243-cd57855d972b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:32.943190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399a1e1-fe97-4440-9243-cd57855d972b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:32.944707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399a1e1-fe97-4440-9243-cd57855d972b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:32.945129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 338/679] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:32.946026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399a1e1-fe97-4440-9243-cd57855d972b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:32.949783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:33.002492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95fd42-6c04-4eec-a1a6-3a38845fd26e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.037585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.038382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.038666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.038939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.046048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:33.047507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:33.060501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399a1e1-fe97-4440-9243-cd57855d972b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:33.062275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:33.063167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:33.064087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 342/680] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:33.064627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:33.107767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a8cfb-6b32-4977-bf23-4e9026d729f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.109342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a8cfb-6b32-4977-bf23-4e9026d729f1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.110000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a8cfb-6b32-4977-bf23-4e9026d729f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.110000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a8cfb-6b32-4977-bf23-4e9026d729f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.117822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a8cfb-6b32-4977-bf23-4e9026d729f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:33.119552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a8cfb-6b32-4977-bf23-4e9026d729f1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-df7a8cfb-6b32-4977-bf23-4e9026d729f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:33.133720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:33.134719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:33.135749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:33.139444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 339/681] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:33.140711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5349-377f-40ab-bdf6-728ecbde26ed None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.141034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5349-377f-40ab-bdf6-728ecbde26ed None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.141352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5349-377f-40ab-bdf6-728ecbde26ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.159277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-eafa5349-377f-40ab-bdf6-728ecbde26ed None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:33.160477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-eafa5349-377f-40ab-bdf6-728ecbde26ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:33.174186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d693a0-ae37-4e67-8cbe-dccd2f931ba7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.188379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:33.212789 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.213487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.213769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.214044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.214881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=2b11f7990b364f5281def98b941e1e00) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:33.215198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:33.216645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:33.223359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 343/682] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:33 2022] GET /identity/v3/role_assignments?user.id=2b11f7990b364f5281def98b941e1e00&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:33.224166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:33.237597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:33.253524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 340/683] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:33.254668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa5349-377f-40ab-bdf6-728ecbde26ed None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:33.360548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c857a0-9c05-46a9-95c0-7d36b285256c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.399974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.400818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.401234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.401629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.402541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:33.403023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:33.404651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:33.416865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa5349-377f-40ab-bdf6-728ecbde26ed None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.419127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 344/684] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:33.420612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:33.459794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:33.465276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.466154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.466589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.467633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.468700 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:33.469398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:33.471175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:33.491158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 341/685] 10.222.0.79 () {56 vars in 1135 bytes} [Fri May 27 09:23:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:33.492126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:33.531854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e9e3-7e67-49be-b6f6-70715da95c0c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.555752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:33.570692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a17cf3-561a-4b77-bb66-e7a0b5283813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.571613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17cf3-561a-4b77-bb66-e7a0b5283813 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.571905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17cf3-561a-4b77-bb66-e7a0b5283813 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.572302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17cf3-561a-4b77-bb66-e7a0b5283813 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.588936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a17cf3-561a-4b77-bb66-e7a0b5283813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c8a17cf3-561a-4b77-bb66-e7a0b5283813 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:33.597910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:33.599104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:33.600133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:33.600950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 345/686] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:33.601723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a17cf3-561a-4b77-bb66-e7a0b5283813 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:33.631404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d530-2d5f-4d58-a98d-252e387638b1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.680980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.682697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.683137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.683877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.685280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=ebee38389afb4270b18c6a14c7a4e302) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:33.685765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:33.688855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:33.696871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 342/687] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:33 2022] GET /identity/v3/role_assignments?user.id=ebee38389afb4270b18c6a14c7a4e302&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:33.698476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:33.705344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:33.714800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a17cf3-561a-4b77-bb66-e7a0b5283813 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.815996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b010c3-2e63-4680-bd90-15867080bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.819052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010c3-2e63-4680-bd90-15867080bf9a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.819797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010c3-2e63-4680-bd90-15867080bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.821469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010c3-2e63-4680-bd90-15867080bf9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.844991 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099731-db61-4ddf-afac-c749b0c4a135 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:33.863889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:33.890891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ddddd-b390-4660-86c3-762844672429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:33.891728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ddddd-b390-4660-86c3-762844672429 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:33.892016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ddddd-b390-4660-86c3-762844672429 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:33.892300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ddddd-b390-4660-86c3-762844672429 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:33.893091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ddddd-b390-4660-86c3-762844672429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:33.893410 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ddddd-b390-4660-86c3-762844672429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:33.895332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ddddd-b390-4660-86c3-762844672429 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:33.906965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 343/688] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:33.912647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ddddd-b390-4660-86c3-762844672429 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:33.936420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b010c3-2e63-4680-bd90-15867080bf9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:33.938253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b010c3-2e63-4680-bd90-15867080bf9a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:34.056867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:34.057054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ddddd-b390-4660-86c3-762844672429 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:34.065112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 346/689] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:34.069061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b010c3-2e63-4680-bd90-15867080bf9a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:34.100067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:34.100973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:34.101269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:34.101547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:34.114477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:34.116030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:34.135381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:34.136343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:34.137288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:34.137288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:34.137288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:34.137288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:34.137515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 344/690] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:34.145864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:34.175818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b010c3-2e63-4680-bd90-15867080bf9a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:34.222477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:34.224866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:34.225675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:34.225961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:34.226239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:34.248550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:34.250112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:34.269510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:34.270446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:34.271356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:34.271356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:34.271356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:34.271356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:34.271356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 347/691] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:34.276656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:34.338310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:34.352379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930ae96-bf2f-4fdc-98e3-8976e92861b8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:34.390752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:34.391423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:34.391709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:34.391989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:34.392711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:34.393049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:34.394429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:34.419566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 345/692] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:34.424983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:34.430352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26179af-dc74-46b4-aee5-f67f6a1ba7bd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:34.469952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:34.471044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:34.471531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:34.472031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:34.472979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:34.473490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:34.475484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:34.489347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 348/693] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:34.495238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:34.616641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb3a1c-e7d1-4fac-8e4e-e40744e84eb1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:34.630806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:34.665241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:34.679488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:34.681373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:34.683231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:34.683718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:34.690237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3a57-0b5f-40d3-951b-f838cbf533b4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:34.704523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:34.706339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:34.723142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:34.724116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:34.725098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:34.725098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:34.725098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:34.725098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:34.725098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:34.725098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:34.725098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:34.725098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:34.727715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 349/694] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:34.735229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:34.782048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:34.782849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:34.783130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:34.783405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:34.797920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:34.799386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:34.826629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:34.827695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:34.828673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:34.842094 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 346/695] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:23:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:34.843081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:34.941936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2cf9-3969-4411-a02b-70dfbdee0e64 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:35.013518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:35.014186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:35.014490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:35.017677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:35.017677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:35.017677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:35.021838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:35.047445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4484-5a17-4fd5-9eb1-0318420ed197 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:35.053654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 350/696] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:35.054541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:35.121221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:35.138137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:35.138839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:35.139121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:35.139395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:35.140841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:35.141155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:35.142790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:35.181107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 347/697] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:23:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:35.187903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:35.226610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:35.323979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eb406-c861-4120-969a-d2471fecb36b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:35.396995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a76eb-102d-444d-97c6-9ba7752bf2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:35.398518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a76eb-102d-444d-97c6-9ba7752bf2dd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:35.398518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a76eb-102d-444d-97c6-9ba7752bf2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:35.398518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a76eb-102d-444d-97c6-9ba7752bf2dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:35.401995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a76eb-102d-444d-97c6-9ba7752bf2dd None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=113f9a9f11014b9ba3efe6781615d68b) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:35.401995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a76eb-102d-444d-97c6-9ba7752bf2dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:35.401995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a76eb-102d-444d-97c6-9ba7752bf2dd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:35.408081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 351/698] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:35 2022] GET /identity/v3/role_assignments?user.id=113f9a9f11014b9ba3efe6781615d68b&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 608 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:35.415371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20657-5f16-4d09-b2b9-6a46e7789bad None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:35.418082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2421-c94e-419c-be75-ff6c552055d7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:35.419261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2421-c94e-419c-be75-ff6c552055d7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:35.419261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da2421-c94e-419c-be75-ff6c552055d7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:35.420509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 352/699] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:35.435643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edee5cc-7175-49fe-876a-0cec52ad9171 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:35.436013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edee5cc-7175-49fe-876a-0cec52ad9171 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:35.436290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edee5cc-7175-49fe-876a-0cec52ad9171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:35.461723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2aa5-5e5d-4924-81cb-58517a87c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:35.463063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2aa5-5e5d-4924-81cb-58517a87c537 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:35.463551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2aa5-5e5d-4924-81cb-58517a87c537 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:35.464027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2aa5-5e5d-4924-81cb-58517a87c537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:35.472548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9edee5cc-7175-49fe-876a-0cec52ad9171 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:35.473960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9edee5cc-7175-49fe-876a-0cec52ad9171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:35.575440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 353/700] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:35.633783 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edee5cc-7175-49fe-876a-0cec52ad9171 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:35.691897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af2aa5-5e5d-4924-81cb-58517a87c537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:35.694130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af2aa5-5e5d-4924-81cb-58517a87c537 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:35.695526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:35.717231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:35.789861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edee5cc-7175-49fe-876a-0cec52ad9171 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:35.811518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 348/701] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:35.818184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2aa5-5e5d-4924-81cb-58517a87c537 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:35.832577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:35.833449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:35.833732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:35.834003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:35.834649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:35.835993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:35.854298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:35.855556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:35.856699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:35.860464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 354/702] 10.222.0.79 () {56 vars in 1129 bytes} [Fri May 27 09:23:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:35.861838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:35.935061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2aa5-5e5d-4924-81cb-58517a87c537 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:35.945899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:35.968591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:35.983655 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b84fa-83ba-499b-86ed-0bfa1fbf10b9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:35.983871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2e18e-28bf-43d2-8431-b6e8e1e09188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:35.984718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2e18e-28bf-43d2-8431-b6e8e1e09188 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:35.985304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2e18e-28bf-43d2-8431-b6e8e1e09188 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:35.985585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2e18e-28bf-43d2-8431-b6e8e1e09188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:35.998365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2e18e-28bf-43d2-8431-b6e8e1e09188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.000344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2e18e-28bf-43d2-8431-b6e8e1e09188 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-f8c2e18e-28bf-43d2-8431-b6e8e1e09188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:36.022976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:36.023944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:36.024896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:36.024896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:36.024896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:36.024896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:36.025121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:36.025121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.025121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.025121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.025394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:36.025394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.026633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.028907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 349/703] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:36.031406 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d1d0-6f13-4449-93af-8a2ac4ad272e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.031694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d1d0-6f13-4449-93af-8a2ac4ad272e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.031974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d1d0-6f13-4449-93af-8a2ac4ad272e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.033129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 355/704] 10.222.0.79 () {56 vars in 1124 bytes} [Fri May 27 09:23:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:36.038199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:36.038752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 350/705] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:36.039540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d1d0-6f13-4449-93af-8a2ac4ad272e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:36.146444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510b6e-5edb-4a45-b42e-4eb9f06d540d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:36.148744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d1d0-6f13-4449-93af-8a2ac4ad272e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:36.183199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba6890-f6fc-487f-b4d1-a05a93679aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:36.183871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba6890-f6fc-487f-b4d1-a05a93679aef None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.184155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba6890-f6fc-487f-b4d1-a05a93679aef None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.184431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba6890-f6fc-487f-b4d1-a05a93679aef None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.185120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:36.185255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba6890-f6fc-487f-b4d1-a05a93679aef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:36.185459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba6890-f6fc-487f-b4d1-a05a93679aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.186293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.186796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.186926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba6890-f6fc-487f-b4d1-a05a93679aef None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.187401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.188403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:36.188923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.190550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.197194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 351/706] 10.222.0.79 () {56 vars in 1124 bytes} [Fri May 27 09:23:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:36.197194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8abd3-13ba-49cc-837c-e67a2a325777 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.197194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8abd3-13ba-49cc-837c-e67a2a325777 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.197194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8abd3-13ba-49cc-837c-e67a2a325777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.222596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 356/707] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:36.228242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:36.234097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3dc8abd3-13ba-49cc-837c-e67a2a325777 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:36.235349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3dc8abd3-13ba-49cc-837c-e67a2a325777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:36.249224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:36.277341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:36.383840 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 352/708] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:36.397251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa2ab-a374-4570-90be-fbb80b92c1d0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:36.417761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8abd3-13ba-49cc-837c-e67a2a325777 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:36.454693 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af9aec-bb8c-475f-85e0-c6322f1eb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:36.456962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9aec-bb8c-475f-85e0-c6322f1eb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.456962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9aec-bb8c-475f-85e0-c6322f1eb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.456962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9aec-bb8c-475f-85e0-c6322f1eb2a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.472854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af9aec-bb8c-475f-85e0-c6322f1eb2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.475266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af9aec-bb8c-475f-85e0-c6322f1eb2a7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c8af9aec-bb8c-475f-85e0-c6322f1eb2a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:36.495024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:36.495988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:36.496935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:36.496935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:36.496935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:36.496935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:36.496935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:36.496935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:36.496935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:36.496935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:36.500045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 357/709] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:36.505466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93719e4-2c38-4479-b683-bcdf7f14c067 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.505466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93719e4-2c38-4479-b683-bcdf7f14c067 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.505466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93719e4-2c38-4479-b683-bcdf7f14c067 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.505466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 358/710] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:36.508863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93719e4-2c38-4479-b683-bcdf7f14c067 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:36.545296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8abd3-13ba-49cc-837c-e67a2a325777 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:36.586757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b010-2e4b-4593-bd8b-dab305eb007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:36.588384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b010-2e4b-4593-bd8b-dab305eb007d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.588867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b010-2e4b-4593-bd8b-dab305eb007d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.589745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b010-2e4b-4593-bd8b-dab305eb007d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.597508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:36.605883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7b010-2e4b-4593-bd8b-dab305eb007d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.609066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7b010-2e4b-4593-bd8b-dab305eb007d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-5ec7b010-2e4b-4593-bd8b-dab305eb007d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:36.632671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:36.633678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:36.634592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:36.634592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:36.634592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:36.634592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:36.634823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93719e4-2c38-4479-b683-bcdf7f14c067 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:36.637729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 353/711] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:36.638837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819015f7-45a1-4c8d-824e-55f67d42b9c3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.639123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819015f7-45a1-4c8d-824e-55f67d42b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.639424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819015f7-45a1-4c8d-824e-55f67d42b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.651108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:36.670311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-819015f7-45a1-4c8d-824e-55f67d42b9c3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:36.672329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-819015f7-45a1-4c8d-824e-55f67d42b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:36.676161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:36.677112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.677668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.678144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.679412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:36.679922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.681665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.695698 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 359/712] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:36.696792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:36.756070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 354/713] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:36.765353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819015f7-45a1-4c8d-824e-55f67d42b9c3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:36.810672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2b7da-28df-4ad5-bc33-0543291300c6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:36.846199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:36.854377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:36.855313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.855802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.856302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.857364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:36.857873 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.859678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.873063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 360/714] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:36.879644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:36.897004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819015f7-45a1-4c8d-824e-55f67d42b9c3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:36.939544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:36.940570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:36.940871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:36.941155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:36.942019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=742917921213432a8ec7853ccf988fdf) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:36.942587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:36.944227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:36.947075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:36.956903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 355/715] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:36 2022] GET /identity/v3/role_assignments?user.id=742917921213432a8ec7853ccf988fdf&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:36.956903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:37.054120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b08be-1cb2-42a5-aed8-04a5a5dc9288 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:37.123142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:37.124547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:37.124852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:37.125142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] PATH_INFO: `/v3/services/network` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:37.125804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:37.127206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:37.135471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e82931-600a-4e1f-b706-47762a1035c9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:37.152793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:37.153872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:37.154729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:37.157830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 361/716] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:36 2022] GET /identity/v3/services/network => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:37.163319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:37.171693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829550-2bce-4110-9038-be7e6c88dd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:37.172375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829550-2bce-4110-9038-be7e6c88dd9e None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:37.172709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829550-2bce-4110-9038-be7e6c88dd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:37.173018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829550-2bce-4110-9038-be7e6c88dd9e None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:37.173770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4829550-2bce-4110-9038-be7e6c88dd9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:37.175294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4829550-2bce-4110-9038-be7e6c88dd9e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:37.199016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 356/717] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:23:36 2022] POST /identity/v3/users => generated 254 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:37.272631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:37.350167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9295e-1a7a-4256-8899-058c4b587a3f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:37.402558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc179-22a8-4db9-84e8-146e7032f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:37.403257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc179-22a8-4db9-84e8-146e7032f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:37.403543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc179-22a8-4db9-84e8-146e7032f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:37.403825 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc179-22a8-4db9-84e8-146e7032f9e2 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:37.404545 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc179-22a8-4db9-84e8-146e7032f9e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:37.404867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc179-22a8-4db9-84e8-146e7032f9e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:37.406834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc179-22a8-4db9-84e8-146e7032f9e2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:37.413040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 362/718] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:23:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:37.418221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829550-2bce-4110-9038-be7e6c88dd9e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:37.479643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:37.526479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829550-2bce-4110-9038-be7e6c88dd9e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:37.560415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c842d-6014-4827-a9b8-f5bbd46cdba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:37.561122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c842d-6014-4827-a9b8-f5bbd46cdba7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:37.561946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c842d-6014-4827-a9b8-f5bbd46cdba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:37.562225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c842d-6014-4827-a9b8-f5bbd46cdba7 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:37.562937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c842d-6014-4827-a9b8-f5bbd46cdba7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:37.563243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c842d-6014-4827-a9b8-f5bbd46cdba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:37.564617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c842d-6014-4827-a9b8-f5bbd46cdba7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:37.569773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 357/719] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:23:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:38.183483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd414fc-80e0-4659-b895-5d7c6c3f6ad6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:38.184000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd414fc-80e0-4659-b895-5d7c6c3f6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:38.184319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd414fc-80e0-4659-b895-5d7c6c3f6ad6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:38.186082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 363/720] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:38.191944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b03f-b960-4e27-837c-b52387f21a56 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:38.192365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b03f-b960-4e27-837c-b52387f21a56 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:38.192540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b03f-b960-4e27-837c-b52387f21a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:38.210017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4457b03f-b960-4e27-837c-b52387f21a56 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:38.211197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4457b03f-b960-4e27-837c-b52387f21a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:38.281034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 358/721] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:38.324706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd414fc-80e0-4659-b895-5d7c6c3f6ad6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:38.457673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd414fc-80e0-4659-b895-5d7c6c3f6ad6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:38.476338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:38.498355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c533f42-4d89-434a-a791-3119cb9da4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:38.499224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c533f42-4d89-434a-a791-3119cb9da4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:38.499515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c533f42-4d89-434a-a791-3119cb9da4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:38.499794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c533f42-4d89-434a-a791-3119cb9da4e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:38.515196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c533f42-4d89-434a-a791-3119cb9da4e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1c533f42-4d89-434a-a791-3119cb9da4e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:38.523075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:38.524056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:38.525013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 364/722] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:38.532720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457b03f-b960-4e27-837c-b52387f21a56 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:38.587120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:38.640139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457b03f-b960-4e27-837c-b52387f21a56 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:38.644571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01309-4ec8-43c6-ac93-46e8714fcf68 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:38.644881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01309-4ec8-43c6-ac93-46e8714fcf68 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:38.645166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01309-4ec8-43c6-ac93-46e8714fcf68 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:38.646664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 365/723] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:38.651774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a043-4135-455f-85a3-91d94e270fbd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:38.652316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a043-4135-455f-85a3-91d94e270fbd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:38.652862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a043-4135-455f-85a3-91d94e270fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:38.679039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:38.679714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:38.679992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:38.680267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:38.681039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:38.681352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:38.682728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:38.684189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f716a043-4135-455f-85a3-91d94e270fbd None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:38.685918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f716a043-4135-455f-85a3-91d94e270fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:38.693606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 359/724] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:38.697210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:38.783532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 366/725] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:38.818818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a043-4135-455f-85a3-91d94e270fbd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:38.876622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4004409-a35f-41ed-b79a-d54bdf915142 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:38.901139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:38.925773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a043-4135-455f-85a3-91d94e270fbd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:38.935071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:38.947939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:38.948745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:38.949053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:38.949338 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:38.961009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c357c93-bd51-466e-8124-1ad46e289a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:38.961779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c357c93-bd51-466e-8124-1ad46e289a6e None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:38.962330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c357c93-bd51-466e-8124-1ad46e289a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:38.962609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c357c93-bd51-466e-8124-1ad46e289a6e None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:38.963348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c357c93-bd51-466e-8124-1ad46e289a6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:38.964734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c357c93-bd51-466e-8124-1ad46e289a6e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:38.975915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:38.978607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:38.988347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 367/726] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:23:38 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:39.002544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:39.003536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:39.004534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:39.004534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:39.004534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:39.004534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:39.004534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 360/727] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:39.011431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c357c93-bd51-466e-8124-1ad46e289a6e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:39.176937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c357c93-bd51-466e-8124-1ad46e289a6e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:39.225703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:39.227184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:39.227692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:39.228173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:39.229135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:39.229650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:39.231348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:39.250285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 368/728] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:39.256028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:39.364474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529367-7bc8-4a8b-884c-03687b1562b8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:39.399416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:39.400221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:39.400506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:39.400787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:39.408726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:39.410195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:39.424815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:39.425830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:39.426826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 361/729] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:39.431913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:39.459893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:39.561412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2d5de-42b4-46cb-a195-d3fcf4b47de7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:39.603215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26b2e0-0636-400a-8495-fb5f836da671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:39.603896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26b2e0-0636-400a-8495-fb5f836da671 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:39.604183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26b2e0-0636-400a-8495-fb5f836da671 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:39.604525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26b2e0-0636-400a-8495-fb5f836da671 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:39.605439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26b2e0-0636-400a-8495-fb5f836da671 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:39.605753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26b2e0-0636-400a-8495-fb5f836da671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:39.607189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26b2e0-0636-400a-8495-fb5f836da671 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:39.625806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 369/730] 10.222.0.79 () {56 vars in 1135 bytes} [Fri May 27 09:23:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:39.631391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:39.657814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:39.706197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dfb27-bccb-4643-8662-8d491d9b9566 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:39.706501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dfb27-bccb-4643-8662-8d491d9b9566 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:39.706664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dfb27-bccb-4643-8662-8d491d9b9566 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:39.708276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 370/731] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:39.713694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd19e7-2bc6-4647-a89b-a099774c8d08 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:39.713985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd19e7-2bc6-4647-a89b-a099774c8d08 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:39.714269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd19e7-2bc6-4647-a89b-a099774c8d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:39.739290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2e7cf-7241-4ee7-9178-c8a62a033710 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:39.752223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c5cd19e7-2bc6-4647-a89b-a099774c8d08 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:39.753699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c5cd19e7-2bc6-4647-a89b-a099774c8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:39.779289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54bfa2-2a5c-4591-ab93-d3474fa389bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:39.781512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bfa2-2a5c-4591-ab93-d3474fa389bb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:39.781798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bfa2-2a5c-4591-ab93-d3474fa389bb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:39.782082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bfa2-2a5c-4591-ab93-d3474fa389bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:39.878676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 371/732] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:23:39.904800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54bfa2-2a5c-4591-ab93-d3474fa389bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:39.906903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54bfa2-2a5c-4591-ab93-d3474fa389bb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:39.927366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd19e7-2bc6-4647-a89b-a099774c8d08 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:39.946874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:39.947857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:40.038366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 362/733] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:23:40.043745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54bfa2-2a5c-4591-ab93-d3474fa389bb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.121801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd19e7-2bc6-4647-a89b-a099774c8d08 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.149014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54bfa2-2a5c-4591-ab93-d3474fa389bb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.175202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:40.180274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3e8f-64ab-4869-9ace-c502bfaba0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.181110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3e8f-64ab-4869-9ace-c502bfaba0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.181394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3e8f-64ab-4869-9ace-c502bfaba0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.181669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3e8f-64ab-4869-9ace-c502bfaba0c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.188992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.189801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.190097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.190382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.192923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e3e8f-64ab-4869-9ace-c502bfaba0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c46e3e8f-64ab-4869-9ace-c502bfaba0c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:40.200537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:40.201525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:40.202564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:40.203352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:40.203436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 372/734] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:40.203515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:40.209180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3e8f-64ab-4869-9ace-c502bfaba0c9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:40.221643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:40.222689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:40.223861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:40.223861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:40.223861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:40.223861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:40.223861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 363/735] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:40.228503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.298536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:40.334230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3e8f-64ab-4869-9ace-c502bfaba0c9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.382707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105547c5-ee21-4deb-bde1-a19eb301bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.383386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105547c5-ee21-4deb-bde1-a19eb301bc61 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.383668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105547c5-ee21-4deb-bde1-a19eb301bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.384094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105547c5-ee21-4deb-bde1-a19eb301bc61 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.385155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105547c5-ee21-4deb-bde1-a19eb301bc61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:40.385469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105547c5-ee21-4deb-bde1-a19eb301bc61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:40.386911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105547c5-ee21-4deb-bde1-a19eb301bc61 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:40.398543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 373/736] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:40.399834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94988-350e-41ac-831f-ba259be07bad None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.400122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94988-350e-41ac-831f-ba259be07bad None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.400400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94988-350e-41ac-831f-ba259be07bad None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.400641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b0768-f7c4-4ca4-8027-04562f64fe36 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.401872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 374/737] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:40.405596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94988-350e-41ac-831f-ba259be07bad None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.442759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f04e82-269b-4eaf-9298-71c2245adefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.443672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04e82-269b-4eaf-9298-71c2245adefc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.444116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04e82-269b-4eaf-9298-71c2245adefc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.444467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04e82-269b-4eaf-9298-71c2245adefc None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.445310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f04e82-269b-4eaf-9298-71c2245adefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:40.445687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f04e82-269b-4eaf-9298-71c2245adefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:40.447194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f04e82-269b-4eaf-9298-71c2245adefc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:40.459912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 364/738] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:40.461477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880875-29d8-4a53-8755-83b055f0a6db None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.461843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880875-29d8-4a53-8755-83b055f0a6db None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.462563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880875-29d8-4a53-8755-83b055f0a6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.480845 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-15880875-29d8-4a53-8755-83b055f0a6db None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:40.482165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-15880875-29d8-4a53-8755-83b055f0a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:40.516147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:40.530897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94988-350e-41ac-831f-ba259be07bad None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.565361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 365/739] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:40.565361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880875-29d8-4a53-8755-83b055f0a6db None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.573572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35504d1-1173-4fa9-b0f7-2384704e93e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.574416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35504d1-1173-4fa9-b0f7-2384704e93e2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.574697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35504d1-1173-4fa9-b0f7-2384704e93e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.574971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35504d1-1173-4fa9-b0f7-2384704e93e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.577969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:40.587968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35504d1-1173-4fa9-b0f7-2384704e93e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:40.589501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35504d1-1173-4fa9-b0f7-2384704e93e2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b35504d1-1173-4fa9-b0f7-2384704e93e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:40.607431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:40.608391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 375/740] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee18c-0d38-47d0-9cbc-a45b984fae4e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee18c-0d38-47d0-9cbc-a45b984fae4e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee18c-0d38-47d0-9cbc-a45b984fae4e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.616923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 376/741] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:40.617589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee18c-0d38-47d0-9cbc-a45b984fae4e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.676512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880875-29d8-4a53-8755-83b055f0a6db None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.715108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ebd3c-ebf8-44d7-b564-9c94e1c83942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.716182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ebd3c-ebf8-44d7-b564-9c94e1c83942 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.716650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ebd3c-ebf8-44d7-b564-9c94e1c83942 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.716958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ebd3c-ebf8-44d7-b564-9c94e1c83942 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.722098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee18c-0d38-47d0-9cbc-a45b984fae4e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.723953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ebd3c-ebf8-44d7-b564-9c94e1c83942 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:40.725439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ebd3c-ebf8-44d7-b564-9c94e1c83942 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-425ebd3c-ebf8-44d7-b564-9c94e1c83942 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:40.739657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:40.740935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 366/742] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745297ef-876d-4874-8c98-5ca84684448b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.742521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745297ef-876d-4874-8c98-5ca84684448b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.743705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745297ef-876d-4874-8c98-5ca84684448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.761993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-745297ef-876d-4874-8c98-5ca84684448b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:40.763188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-745297ef-876d-4874-8c98-5ca84684448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:40.769170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc6bc2-959e-4953-a851-81e66cbca211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.769966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc6bc2-959e-4953-a851-81e66cbca211 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.770248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc6bc2-959e-4953-a851-81e66cbca211 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.770528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc6bc2-959e-4953-a851-81e66cbca211 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.781249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:40.781387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc6bc2-959e-4953-a851-81e66cbca211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c5fc6bc2-959e-4953-a851-81e66cbca211 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:40.789231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:40.790194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:40.791058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 377/743] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:40.792466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc6bc2-959e-4953-a851-81e66cbca211 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.841523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:40.845753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 367/744] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:23:40.846901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745297ef-876d-4874-8c98-5ca84684448b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.906037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc6bc2-959e-4953-a851-81e66cbca211 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.941857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.942626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.943011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.943292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.944008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:40.944316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:40.945703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:40.957643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745297ef-876d-4874-8c98-5ca84684448b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:40.962813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 378/745] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:40.962813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:40.996902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:40.997561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:40.997838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:40.998107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:40.999460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:40.999770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.001205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.017434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 368/746] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:41.017434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.031317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:41.069929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b2f35-29f7-4cd3-87c5-a8b09bd72fa0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.079788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:41.108821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.109832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.110187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.110461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.111201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:41.111509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.112891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.120473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a20f29-043f-4d7a-9e79-c115adea9937 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.125314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 379/747] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:41.125314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.159654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be94898-2479-4320-9a69-09d5ba2aca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.160333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be94898-2479-4320-9a69-09d5ba2aca28 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.160613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be94898-2479-4320-9a69-09d5ba2aca28 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.160931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be94898-2479-4320-9a69-09d5ba2aca28 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.161656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be94898-2479-4320-9a69-09d5ba2aca28 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.163021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be94898-2479-4320-9a69-09d5ba2aca28 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.178592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 369/748] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:23:41 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:41.179437 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be94898-2479-4320-9a69-09d5ba2aca28 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.238680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1176a-1013-4453-8c40-13e17fcbd7cc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.289413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.290228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.290510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.290788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.309393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.311645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.314521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:41.334265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:41.335342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:41.336318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:41.340481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 380/749] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:23:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:41.341742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.355570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be94898-2479-4320-9a69-09d5ba2aca28 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.379116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:41.402345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.403739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.404092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.404443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.405927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=113f9a9f11014b9ba3efe6781615d68b) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:41.406409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.408604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.415256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 370/750] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:41 2022] GET /identity/v3/role_assignments?user.id=113f9a9f11014b9ba3efe6781615d68b&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:41.416142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.485465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67e3a-d1f9-4d56-839f-1e445b7b8de8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.522696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.523861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.524350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.524913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.537019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.538880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.539145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3589c9-5e29-449c-8895-4efd809b560e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:41.572713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:41.577271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:41.578252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:41.578252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:41.578252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:41.578252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:41.580651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 381/751] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:41.586140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.591566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.591960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.592227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.592581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.596296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:41.596620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.598203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.616408 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:41.637136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 371/752] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:23:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:41.643219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.686764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:41.707622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb45f4-52a1-4a8f-82c7-bca6ea5c5aa0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.749706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.751589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.753077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.754678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.755652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:41.756356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.758808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.778829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 382/753] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:41.784701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.838911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7a76d-c6b4-432c-a2f8-e02784fec4b9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.895423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b3fb3-da64-4602-8c25-be660fde6e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.896149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b3fb3-da64-4602-8c25-be660fde6e69 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.896434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b3fb3-da64-4602-8c25-be660fde6e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.896711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b3fb3-da64-4602-8c25-be660fde6e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.911208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b3fb3-da64-4602-8c25-be660fde6e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.912971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b3fb3-da64-4602-8c25-be660fde6e69 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:41.934442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f4062-61a8-4818-aac6-7e1d96ce794e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-435b3fb3-da64-4602-8c25-be660fde6e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:41.938661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:41.939565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:41.940484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:41.940484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:41.940484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:41.940484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:41.940484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 372/754] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:41.941635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39b40-27ce-4ed5-a458-2840b80c825a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.941921 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39b40-27ce-4ed5-a458-2840b80c825a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.942201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f39b40-27ce-4ed5-a458-2840b80c825a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.948048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 373/755] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:41.948862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f39b40-27ce-4ed5-a458-2840b80c825a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:41.977470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a515c54-ab08-4871-935e-ebd5e6e917f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:41.978651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a515c54-ab08-4871-935e-ebd5e6e917f5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:41.979154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a515c54-ab08-4871-935e-ebd5e6e917f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:41.979671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a515c54-ab08-4871-935e-ebd5e6e917f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:41.984003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:41.990546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a515c54-ab08-4871-935e-ebd5e6e917f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:41.992537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a515c54-ab08-4871-935e-ebd5e6e917f5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8a515c54-ab08-4871-935e-ebd5e6e917f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:42.008630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:42.009822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:23:42.010994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:42.013573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 383/756] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:23:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:42.015008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9286-eefb-4893-81b3-fb4392a38044 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.015471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:42.015704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9286-eefb-4893-81b3-fb4392a38044 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.016214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9286-eefb-4893-81b3-fb4392a38044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.034268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b03c9286-eefb-4893-81b3-fb4392a38044 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:42.035803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b03c9286-eefb-4893-81b3-fb4392a38044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:42.083541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f39b40-27ce-4ed5-a458-2840b80c825a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:42.120462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:42.121556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.122125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.122605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.124124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:42.124663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:42.132850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 384/757] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:42.132850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c9286-eefb-4893-81b3-fb4392a38044 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:42.133603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.151423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 374/758] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:42.156451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:42.253124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c9286-eefb-4893-81b3-fb4392a38044 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:42.274853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1a97e-abea-4ecc-b685-8453eed7f922 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:42.283916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:42.287859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:42.299691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:42.300796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.304225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.304816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.305967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:42.307179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:42.308960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.324086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265b42-3f32-4895-9d18-943632042492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:42.325026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265b42-3f32-4895-9d18-943632042492 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.325315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265b42-3f32-4895-9d18-943632042492 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.325597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265b42-3f32-4895-9d18-943632042492 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.330601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 385/759] 10.222.0.79 () {56 vars in 1149 bytes} [Fri May 27 09:23:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:42.331999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:42.334628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07265b42-3f32-4895-9d18-943632042492 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:42.341861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07265b42-3f32-4895-9d18-943632042492 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-07265b42-3f32-4895-9d18-943632042492 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:42.363022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:42.363944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:42.365269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 375/760] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:42.365798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265b42-3f32-4895-9d18-943632042492 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:42.454689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bfc06-e79f-43c4-888b-721412f8628d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:42.478395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265b42-3f32-4895-9d18-943632042492 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:42.501965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:42.502782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.503071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.503355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.504287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:42.506394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.516647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644d3f-323d-471e-b56a-769a7a04d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:42.517663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644d3f-323d-471e-b56a-769a7a04d43f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.518170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644d3f-323d-471e-b56a-769a7a04d43f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.518647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644d3f-323d-471e-b56a-769a7a04d43f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:42.521791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:42.522740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:42.523604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:42.528818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 386/761] 10.222.0.79 () {56 vars in 1129 bytes} [Fri May 27 09:23:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:42.529816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:42.564288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:42.602715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:42.605128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644d3f-323d-471e-b56a-769a7a04d43f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:42.606827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644d3f-323d-471e-b56a-769a7a04d43f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.671131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451975e0-5eb1-4781-8997-e438b3f201b4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:42.707940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:42.708994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.709497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.709987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.710980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:42.711492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:42.713407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.726408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 387/762] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:42.727556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:42.734181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 376/763] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:23:42.735217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644d3f-323d-471e-b56a-769a7a04d43f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:42.805290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:42.846235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644d3f-323d-471e-b56a-769a7a04d43f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:42.853013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75085ad-c791-4f57-b72f-6b9984ecba85 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:42.863213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:42.892322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:42.893362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.893854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.894294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec599-541e-47b1-846d-b417c8aebc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:42.894593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.895182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec599-541e-47b1-846d-b417c8aebc46 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:42.895472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec599-541e-47b1-846d-b417c8aebc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:42.895753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec599-541e-47b1-846d-b417c8aebc46 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/742917921213432a8ec7853ccf988fdf/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:42.896190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:42.896707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:42.897767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec599-541e-47b1-846d-b417c8aebc46 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=742917921213432a8ec7853ccf988fdf, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:42.898521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.899197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec599-541e-47b1-846d-b417c8aebc46 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:42.905525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 388/764] 10.222.0.79 () {56 vars in 1124 bytes} [Fri May 27 09:23:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:42.906373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:42.917013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 377/765] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:23:42 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/742917921213432a8ec7853ccf988fdf/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:42.918213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec599-541e-47b1-846d-b417c8aebc46 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:43.026538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7f50-4c79-4a53-9d6f-1e9bd0dd5e02 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:43.028701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec599-541e-47b1-846d-b417c8aebc46 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:43.058066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:43.075415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:43.078076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.079028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.080314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.081627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:43.081978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:43.083091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.083641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:43.085417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:43.086024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.086525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.100580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 378/766] 10.222.0.79 () {56 vars in 1124 bytes} [Fri May 27 09:23:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:43.109222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:43.111638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:43.115077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:43.149239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:43.150216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:43.151212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:43.151212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:43.151212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:43.151212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:43.153510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 389/767] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:43.160979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:43.203951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:43.258406 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6fdf-f83e-4b47-82b5-4126714bde68 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:43.296027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9665-8c2d-49c3-b7de-d53a7ea35772 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:43.298671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:43.299618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.300064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.300471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.302377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] RBAC: Adding query filter params (interface=public, service_id=a7c8e67dec684f2781e414a20d6ba13d, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:43.302874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:43.304594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:43.319891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 379/768] 10.222.0.79 () {56 vars in 1251 bytes} [Fri May 27 09:23:43 2022] GET /identity/v3/endpoints?service_id=a7c8e67dec684f2781e414a20d6ba13d&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:43.321188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:43.336741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:43.337816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.338022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.338348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.339079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:43.339383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:43.340787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:43.356980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 390/769] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:43.358704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:43.417863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:43.472756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e685307-f857-4a08-8e70-209271522ca3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:43.477062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:43.517171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:43.518030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.518318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.518597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.532753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:43.534265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:43.536742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e433-da63-427a-bf08-d31dcd3b5173 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:43.571680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:43.572688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:43.573643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:43.573643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:43.573643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:43.573643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:43.573643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:43.573643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:43.573643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:43.573643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:43.577674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 391/770] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:43.582204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:43.582868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd52b7-0b84-4d8f-84b2-11c88f4ab9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:43.583563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd52b7-0b84-4d8f-84b2-11c88f4ab9fc None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.583853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd52b7-0b84-4d8f-84b2-11c88f4ab9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.584131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd52b7-0b84-4d8f-84b2-11c88f4ab9fc None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.584843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd52b7-0b84-4d8f-84b2-11c88f4ab9fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:43.586224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd52b7-0b84-4d8f-84b2-11c88f4ab9fc None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:43.601753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 380/771] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:23:43 2022] GET /identity/v3/services => generated 772 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:43.731776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31337a-d1fc-4cde-88e6-745016552a73 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:43.782524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313eb0-d65e-4ec1-81bd-d90c57fb6121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:43.783315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313eb0-d65e-4ec1-81bd-d90c57fb6121 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.783601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313eb0-d65e-4ec1-81bd-d90c57fb6121 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.783883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313eb0-d65e-4ec1-81bd-d90c57fb6121 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.784690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313eb0-d65e-4ec1-81bd-d90c57fb6121 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:43.785027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313eb0-d65e-4ec1-81bd-d90c57fb6121 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:43.786923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313eb0-d65e-4ec1-81bd-d90c57fb6121 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:43.808337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 392/772] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:43.815970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd52b7-0b84-4d8f-84b2-11c88f4ab9fc None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:43.854295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433112d-899b-4fae-827e-8a08a94e7849 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.854905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433112d-899b-4fae-827e-8a08a94e7849 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.855404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433112d-899b-4fae-827e-8a08a94e7849 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.857327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 393/773] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:43.862931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa9f3-f483-4815-b612-27955149d85e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.863494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa9f3-f483-4815-b612-27955149d85e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.863975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa9f3-f483-4815-b612-27955149d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.871044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:43.887943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a51fa9f3-f483-4815-b612-27955149d85e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:43.889352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a51fa9f3-f483-4815-b612-27955149d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:43.947385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd52b7-0b84-4d8f-84b2-11c88f4ab9fc None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:43.972617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:43.988522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 394/774] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:43.990202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c34eb0-7bb8-4067-8d94-198c4861d1ff None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:43.990700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c34eb0-7bb8-4067-8d94-198c4861d1ff None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:43.991179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c34eb0-7bb8-4067-8d94-198c4861d1ff None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:43.992975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 395/775] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:44.002244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633639b6-2e27-4fdb-8d3e-ccd518fe99d4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:44.002784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633639b6-2e27-4fdb-8d3e-ccd518fe99d4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:44.003148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:44.003508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633639b6-2e27-4fdb-8d3e-ccd518fe99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:44.003823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:44.004110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:44.004390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:44.005289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=8a346babd29541b4ae699731bc801b8c) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:44.005605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:44.008790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:44.016163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 381/776] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:43 2022] GET /identity/v3/role_assignments?user.id=8a346babd29541b4ae699731bc801b8c&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:44.023572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:44.030564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-633639b6-2e27-4fdb-8d3e-ccd518fe99d4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:44.032008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-633639b6-2e27-4fdb-8d3e-ccd518fe99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:44.157654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 396/777] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:44.192070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabbc8f-017c-4ba5-8f97-5c8a35e172c8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:44.208204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633639b6-2e27-4fdb-8d3e-ccd518fe99d4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:44.255350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:44.255350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:44.255676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:44.255828 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] PATH_INFO: `/v3/services/network` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:44.256511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:44.260871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:44.274946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:44.276213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:44.277340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 382/778] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:44 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:44.285405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:44.310947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:44.352242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:44.413898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7b7af-44c7-4908-8c9c-dbf09198f766 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:44.422715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633639b6-2e27-4fdb-8d3e-ccd518fe99d4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:44.456908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:44.457972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:44.458457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:44.458934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:44.459846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] RBAC: Adding query filter params (name=network) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:44.460350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:44.462681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:44.468886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 383/779] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:23:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:44.474010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:44.517569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb743a-1426-48c4-9961-7e7ef0bb9ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:44.518424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb743a-1426-48c4-9961-7e7ef0bb9ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:44.518717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb743a-1426-48c4-9961-7e7ef0bb9ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:44.519002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb743a-1426-48c4-9961-7e7ef0bb9ee4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:44.547932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb743a-1426-48c4-9961-7e7ef0bb9ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f3bb743a-1426-48c4-9961-7e7ef0bb9ee4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:44.555916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:44.556931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:44.557793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:44.569390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 397/780] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:44.578189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb743a-1426-48c4-9961-7e7ef0bb9ee4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:44.598934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb849-a1e6-48bb-aeae-161c1bd39847 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:44.614815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:44.642815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:44.643825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:44.644335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:44.644813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:44.645941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] RBAC: Adding query filter params (type=network) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:44.646679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:44.648654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:44.655696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 384/781] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:23:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:44.661702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:44.776916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8beac45-7290-4c5b-ad9f-80c24e1901ae None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:44.802574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb743a-1426-48c4-9961-7e7ef0bb9ee4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:44.818007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:44.819014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:44.819500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:44.819978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:44.821010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] RBAC: Adding query filter params (interface=public, service_id=e533541880d443ec83bfe54a3fce522e, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:44.821527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:44.823615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:44.831435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 385/782] 10.222.0.79 () {56 vars in 1251 bytes} [Fri May 27 09:23:44 2022] GET /identity/v3/endpoints?service_id=e533541880d443ec83bfe54a3fce522e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:44.837229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:44.853090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:44.876506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:44.877265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:44.877608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:44.877892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:44.878636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:44.878939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:44.880858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:44.890606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:44.898298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 398/783] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:44.903762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:45.010351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40363-4d9d-4ced-a1c6-379a6394fb32 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:45.059636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6c876-34b7-4c75-9af1-b06f314da446 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:45.100519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:45.101352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:45.101639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:45.101925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:45.110142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b103b-b35d-4f4c-a6f8-5a413f0e3c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:45.110832 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b103b-b35d-4f4c-a6f8-5a413f0e3c7e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:45.111123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b103b-b35d-4f4c-a6f8-5a413f0e3c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:45.111401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b103b-b35d-4f4c-a6f8-5a413f0e3c7e None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:45.112090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b103b-b35d-4f4c-a6f8-5a413f0e3c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:45.113503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b103b-b35d-4f4c-a6f8-5a413f0e3c7e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:45.113875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:45.115549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:45.131801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 386/784] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:23:44 2022] GET /identity/v3/services => generated 772 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:45.133983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:45.134876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:45.135767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:45.135767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:45.135767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:45.135767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:45.135767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 399/785] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:45.140758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b103b-b35d-4f4c-a6f8-5a413f0e3c7e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:45.331166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b103b-b35d-4f4c-a6f8-5a413f0e3c7e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:45.333933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:45.368759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:45.369459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:45.369743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:45.370022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:45.370748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:45.371057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:45.372423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:45.385688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 387/786] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:45.391490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:45.448431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:45.512944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193783b-ddcc-4add-be98-d46430dfb873 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:45.562084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e0fe8-0044-4862-8ac1-3e5e40f749ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:45.562903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0fe8-0044-4862-8ac1-3e5e40f749ef None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:45.563189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0fe8-0044-4862-8ac1-3e5e40f749ef None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:45.563469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0fe8-0044-4862-8ac1-3e5e40f749ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:45.571383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e0fe8-0044-4862-8ac1-3e5e40f749ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:45.572866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e0fe8-0044-4862-8ac1-3e5e40f749ef None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e51e0fe8-0044-4862-8ac1-3e5e40f749ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:45.592510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:45.593547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:45.594532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:45.598134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 400/787] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:45.603374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:45.624566 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb27cc-6615-4362-9360-af96cbfe83c0 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:45.624918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb27cc-6615-4362-9360-af96cbfe83c0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:45.625182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb27cc-6615-4362-9360-af96cbfe83c0 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:45.626849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 401/788] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:45.631666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9af52-009b-4525-b562-6eddc4942e42 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:45.631952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9af52-009b-4525-b562-6eddc4942e42 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:45.632240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9af52-009b-4525-b562-6eddc4942e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:45.663089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6ed9af52-009b-4525-b562-6eddc4942e42 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:45.664295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6ed9af52-009b-4525-b562-6eddc4942e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:45.786059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee935c-2395-49ab-a5f5-9de6d431208a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:45.791145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 402/789] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:45.822859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:45.823535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:45.823819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:45.824093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:45.824962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:45.825274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:45.827473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9af52-009b-4525-b562-6eddc4942e42 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:45.828951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:45.860273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 388/790] 10.222.0.79 () {56 vars in 1135 bytes} [Fri May 27 09:23:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:45.866443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:45.889785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:45.917470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:46.007560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9af52-009b-4525-b562-6eddc4942e42 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.018316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be76301-5c26-43bb-82b0-36051149fbae None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.059679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.060466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.060742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.062225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.079532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.083407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.084938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ccae8-0dee-47ce-807d-238ad43a97d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.085735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccae8-0dee-47ce-807d-238ad43a97d0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.086066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccae8-0dee-47ce-807d-238ad43a97d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.086340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ccae8-0dee-47ce-807d-238ad43a97d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.111955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ccae8-0dee-47ce-807d-238ad43a97d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:46.112939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:46.114008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:46.115212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:46.115212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:46.115212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:46.115212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:46.115212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 389/791] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-879ccae8-0dee-47ce-807d-238ad43a97d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:46.119605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:46.120748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:46.121880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:46.122629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.122703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 403/792] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:46.129918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ccae8-0dee-47ce-807d-238ad43a97d0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.205222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:46.229284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ad02-ff25-4bc0-ad45-41cc0d912258 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.265243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.265906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.266185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.266458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.267289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:46.267699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.269084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.281716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 390/793] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:46.287201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.293138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:46.313130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ccae8-0dee-47ce-807d-238ad43a97d0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.358736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856cf18-bea9-4c4a-b72f-9474729d24f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.359664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856cf18-bea9-4c4a-b72f-9474729d24f9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.360160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856cf18-bea9-4c4a-b72f-9474729d24f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.360540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856cf18-bea9-4c4a-b72f-9474729d24f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.361429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856cf18-bea9-4c4a-b72f-9474729d24f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:46.361840 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856cf18-bea9-4c4a-b72f-9474729d24f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.363626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856cf18-bea9-4c4a-b72f-9474729d24f9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.373024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 404/794] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:46.374516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b74569-9318-4657-b993-be3751fec55b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.374912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b74569-9318-4657-b993-be3751fec55b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.375302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b74569-9318-4657-b993-be3751fec55b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.381017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 405/795] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:46.382082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b74569-9318-4657-b993-be3751fec55b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.423992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779db6-0fdd-4b5f-a019-83fbafca6909 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.465105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b6bb6-e0f9-4924-9721-e57c88278312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.465903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6bb6-e0f9-4924-9721-e57c88278312 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.466179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6bb6-e0f9-4924-9721-e57c88278312 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.466453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6bb6-e0f9-4924-9721-e57c88278312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.469088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:46.475062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b6bb6-e0f9-4924-9721-e57c88278312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.476639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b6bb6-e0f9-4924-9721-e57c88278312 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-7f8b6bb6-e0f9-4924-9721-e57c88278312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:46.492954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:46.494073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:46.495130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:46.495130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:46.495130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:46.495130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:46.495130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:46.495130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:46.495130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:46.495130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:46.500166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 391/796] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:46.500784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b74569-9318-4657-b993-be3751fec55b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.501532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0955c-42b0-47e7-9129-328e4738921b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.501820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0955c-42b0-47e7-9129-328e4738921b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.502102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0955c-42b0-47e7-9129-328e4738921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.519703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-71b0955c-42b0-47e7-9129-328e4738921b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:46.521191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-71b0955c-42b0-47e7-9129-328e4738921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:46.538595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.539391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.539779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.540064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.552726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.554253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:46.574158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:46.576355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:46.578716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:46.578716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:46.578716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:46.578716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:46.578716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 406/797] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:46.578716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.579592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:46.596712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 392/798] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:46.597614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0955c-42b0-47e7-9129-328e4738921b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.714508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa20df-6656-4b3f-87ad-216b6824dcbe None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.719150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0955c-42b0-47e7-9129-328e4738921b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.750491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:46.756339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.757039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.757329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.757868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.758676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:46.758993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.760166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.760506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.761258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.761719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.762346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.763731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:46.764744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.766387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.778560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 407/799] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:46.778560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.785453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 393/800] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:46.786961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.849774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:46.890020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003d5a-ad22-4adf-b680-ae53f780aa37 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.912087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e740e1-47a3-465f-9541-1ed76dd09814 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:46.926815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.927712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.928001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.928273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.928944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.930303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:46.942302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:46.943461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:46.945803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 408/801] 10.222.0.79 () {56 vars in 1129 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:46.946708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:46.953413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568345-11ba-42f0-ab36-d0fbcf299418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:46.954311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568345-11ba-42f0-ab36-d0fbcf299418 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.954597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568345-11ba-42f0-ab36-d0fbcf299418 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.954875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568345-11ba-42f0-ab36-d0fbcf299418 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/113f9a9f11014b9ba3efe6781615d68b/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.956929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568345-11ba-42f0-ab36-d0fbcf299418 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=113f9a9f11014b9ba3efe6781615d68b, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:46.958368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568345-11ba-42f0-ab36-d0fbcf299418 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:46.974000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 394/802] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:23:46 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/113f9a9f11014b9ba3efe6781615d68b/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:23:46.975086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacb1c2-ca8c-44b0-8fde-3f37739fecae None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:46.975438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacb1c2-ca8c-44b0-8fde-3f37739fecae None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:46.975783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacb1c2-ca8c-44b0-8fde-3f37739fecae None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:46.980893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 395/803] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:46.980893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacb1c2-ca8c-44b0-8fde-3f37739fecae None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:47.050461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:47.090747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211df5c-c8b1-49c8-a14d-ef908c7b3fb0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:47.118234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:47.125895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacb1c2-ca8c-44b0-8fde-3f37739fecae None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:47.128138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d5d13-b757-41f9-8dcc-1d256cee0450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:47.128987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d5d13-b757-41f9-8dcc-1d256cee0450 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.129271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d5d13-b757-41f9-8dcc-1d256cee0450 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.129548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d5d13-b757-41f9-8dcc-1d256cee0450 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.138022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d5d13-b757-41f9-8dcc-1d256cee0450 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:47.140227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d5d13-b757-41f9-8dcc-1d256cee0450 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-459d5d13-b757-41f9-8dcc-1d256cee0450 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:47.155701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:47.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:23:47.157762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:47.161257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 409/804] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:47.162585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fd264-347a-4f92-9898-1f270295e483 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.162875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fd264-347a-4f92-9898-1f270295e483 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.163172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fd264-347a-4f92-9898-1f270295e483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.173732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:47.174765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.175054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.175384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.176102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:47.176415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:47.177877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:47.183018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-da6fd264-347a-4f92-9898-1f270295e483 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:47.183176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 396/805] 10.222.0.79 () {56 vars in 1124 bytes} [Fri May 27 09:23:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:47.183743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:47.184017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-da6fd264-347a-4f92-9898-1f270295e483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:47.273466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 410/806] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:47.274637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fd264-347a-4f92-9898-1f270295e483 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:47.295404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d7880-aaa4-43e5-b185-d5bac7692d8a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:47.304807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:47.332151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:47.332967 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.333412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.333900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.335514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:47.335833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:47.337597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:47.357932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 397/807] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:23:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:47.358940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:47.390613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fd264-347a-4f92-9898-1f270295e483 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:47.409605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:47.432018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:47.433039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.433560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.434047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.435057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:47.435572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:47.437301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:47.448612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 411/808] 10.222.0.79 () {56 vars in 1124 bytes} [Fri May 27 09:23:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:47.449912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:47.472358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b94a5-b0b5-4665-9830-83ec11092f75 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:47.509355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a68fa-950d-42b3-af7d-d8fa05fedb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:47.510156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a68fa-950d-42b3-af7d-d8fa05fedb45 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.510439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a68fa-950d-42b3-af7d-d8fa05fedb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.510718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a68fa-950d-42b3-af7d-d8fa05fedb45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.522549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a68fa-950d-42b3-af7d-d8fa05fedb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-5f7a68fa-950d-42b3-af7d-d8fa05fedb45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:47.531510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:47.532481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:47.533721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 398/809] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:47.534446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a68fa-950d-42b3-af7d-d8fa05fedb45 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:47.569288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:47.570887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b222-d477-4f3d-9f03-7ae2acf98a87 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:47.608252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b34e08-d955-4396-8119-0415871d48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:47.609291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34e08-d955-4396-8119-0415871d48b0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.609757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34e08-d955-4396-8119-0415871d48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.610216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34e08-d955-4396-8119-0415871d48b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.649076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a68fa-950d-42b3-af7d-d8fa05fedb45 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:47.660388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:47.680654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b34e08-d955-4396-8119-0415871d48b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:47.682536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b34e08-d955-4396-8119-0415871d48b0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:47.688258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c174-6f50-42b7-8090-313b2ef2326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:47.688962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c174-6f50-42b7-8090-313b2ef2326f None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.689251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c174-6f50-42b7-8090-313b2ef2326f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.689535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c174-6f50-42b7-8090-313b2ef2326f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.690282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573c174-6f50-42b7-8090-313b2ef2326f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:47.691861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573c174-6f50-42b7-8090-313b2ef2326f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:47.719460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 399/810] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:23:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:47.720397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c174-6f50-42b7-8090-313b2ef2326f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:47.815142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 412/811] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:23:47.819872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc56d-4b2d-4bba-a54b-337f9dac83ac None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.819872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc56d-4b2d-4bba-a54b-337f9dac83ac None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.819872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc56d-4b2d-4bba-a54b-337f9dac83ac None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.820172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 413/812] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:47.824407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc56d-4b2d-4bba-a54b-337f9dac83ac None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:47.839198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:47.876116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c174-6f50-42b7-8090-313b2ef2326f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:47.923672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bc7f5-8c07-48b0-92d8-c6c4455afba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:47.924357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc7f5-8c07-48b0-92d8-c6c4455afba8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.924637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc7f5-8c07-48b0-92d8-c6c4455afba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.924942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc7f5-8c07-48b0-92d8-c6c4455afba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.925700 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bc7f5-8c07-48b0-92d8-c6c4455afba8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:47.926001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bc7f5-8c07-48b0-92d8-c6c4455afba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:47.927377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bc7f5-8c07-48b0-92d8-c6c4455afba8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:47.939536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 400/813] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:47.940691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ea7f9-4988-4913-a405-599e57b65233 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:47.941009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ea7f9-4988-4913-a405-599e57b65233 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:47.941288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ea7f9-4988-4913-a405-599e57b65233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:47.949408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:47.963066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-715ea7f9-4988-4913-a405-599e57b65233 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:47.964433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-715ea7f9-4988-4913-a405-599e57b65233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:47.977915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc56d-4b2d-4bba-a54b-337f9dac83ac None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.018340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.019192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.019797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.020081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.033473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.035730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.047227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 401/814] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:48.048219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ea7f9-4988-4913-a405-599e57b65233 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:48.069374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:48.070297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:48.071208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:48.071208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:48.071208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:48.071208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:48.071208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 414/815] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:48.077904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.139761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:48.182457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ea7f9-4988-4913-a405-599e57b65233 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.209741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f08f7-54a0-4156-aff6-52d98ad5c481 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.219427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.220253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.220535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.220812 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.232325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.233837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:48.252070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:48.253073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:48.253974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:48.253974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:48.253974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:48.253974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:48.255664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.256594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.257182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.257738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.258159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 402/816] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:48.258940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:48.259045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.259629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.261314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.265175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:48.280303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 415/817] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:48.281546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.391455 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59db2e0-7e35-40e8-a96c-6497b89ac1ef None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.415858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:48.428558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.429403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.429688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.429968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] PATH_INFO: `/v3/services/network` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.430626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.431987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.433217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa894-9273-4bfe-91df-4edf0c7ae64f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:48.443925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:48.444968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:48.446386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 403/818] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:48.447205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.486300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.487020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.487308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.487587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.488308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:48.488613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.490033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.506879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 416/819] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:48.507790 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.567526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b2cd-b0a9-415e-9014-f417b539f1ad None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.568756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:48.607446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.608295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.608604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.609277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.616678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.618012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.630540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a8886-48b1-411f-9858-3435fabb8b64 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:48.635426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:48.636315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:48.637342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:48.637342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:48.637342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:48.637342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:48.637342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:48.637342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:48.637342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:48.637342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:48.642093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 404/820] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:48.642882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.681247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.682259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.682769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.683258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.684666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] RBAC: Adding query filter params (name=network) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:48.685192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.687775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.692004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:48.696288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 417/821] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:48.698037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.761050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe5857-a772-4452-8c62-29792ed7985c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.808426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.809632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.810048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67862889-4ad0-44ea-98fe-987dc751411f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.810349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.811339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.821205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.823577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.828559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:48.851125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:48.851788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:48.852062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:48.852344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:48.853179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:48.853492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:48.855003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:48.856780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:48.858525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:23:48.859694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:48.862505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 405/822] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:48.863501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.878085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 418/823] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:48.879222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:48.991032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ebb16-e211-46fa-9ee6-0639e785354b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.998159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002db1db-56c5-4f9d-9044-2cdbf6af55d7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:48.999488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:49.035341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.036187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.036573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.037013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.037799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:49.038213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.038595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.039457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.039883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.040065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.040629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.041623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:49.042089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.043650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.048171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 406/824] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:49.049248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.066103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 419/825] 10.222.0.79 () {56 vars in 1149 bytes} [Fri May 27 09:23:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:49.067372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.107570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:49.185901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238692-360b-4533-a1bb-9715a7cb22c8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.197679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379235c-14f4-44bf-8604-79b517ab84b5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.233092 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c74e18-27a6-419f-af31-b0ebffeade57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.233768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c74e18-27a6-419f-af31-b0ebffeade57 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.234056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c74e18-27a6-419f-af31-b0ebffeade57 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.234336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c74e18-27a6-419f-af31-b0ebffeade57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.235072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c74e18-27a6-419f-af31-b0ebffeade57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.236453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c74e18-27a6-419f-af31-b0ebffeade57 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.236978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.237644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.237923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.238202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.239052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=742917921213432a8ec7853ccf988fdf) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:49.239364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.240863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.252933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 407/826] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/role_assignments?user.id=742917921213432a8ec7853ccf988fdf&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:49.252933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.275592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 420/827] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:23:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:49.277013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647efc-d453-4c08-b456-121b26d93e66 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.277306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647efc-d453-4c08-b456-121b26d93e66 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.277587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647efc-d453-4c08-b456-121b26d93e66 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.283886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 421/828] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:49.286534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528d5d-60f4-47bf-a647-a430e1ce0d5e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.286817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528d5d-60f4-47bf-a647-a430e1ce0d5e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.287107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528d5d-60f4-47bf-a647-a430e1ce0d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.311529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d5528d5d-60f4-47bf-a647-a430e1ce0d5e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:49.312816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d5528d5d-60f4-47bf-a647-a430e1ce0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:49.314921 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:49.418629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da5911-750f-41b2-ade5-31cb61ba4239 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.419045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 422/829] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:49.439712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5528d5d-60f4-47bf-a647-a430e1ce0d5e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.457710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.458707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.459012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.459390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.461107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:49.471170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.472687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:49.492221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:49.493254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:49.494154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:49.494154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:49.494154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:49.494154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:49.494154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 408/830] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:49.501907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.556597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5528d5d-60f4-47bf-a647-a430e1ce0d5e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.595674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbbc73-637c-4716-ae41-c073e302d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.596479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbbc73-637c-4716-ae41-c073e302d65b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.596764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbbc73-637c-4716-ae41-c073e302d65b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.597065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbbc73-637c-4716-ae41-c073e302d65b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.606212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:49.612572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbbc73-637c-4716-ae41-c073e302d65b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-77fbbc73-637c-4716-ae41-c073e302d65b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:49.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:49.623761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:23:49.624686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:49.631663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8401aeb-4fa2-4489-81c3-9d875eb1dc49 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.632051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 423/831] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:49.634661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbbc73-637c-4716-ae41-c073e302d65b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.673542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.674360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.674746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.675143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.676028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:49.676432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.678011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.695801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 409/832] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:49.696935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.729231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:49.747142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbbc73-637c-4716-ae41-c073e302d65b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.784778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.785865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.786568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.787045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.787986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:49.788513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.790124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.804351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 424/833] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:49.805894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.807570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bbc35-165a-496f-924c-a20c13c42fe1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.846906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.847741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.848024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.848302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.856249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.857726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:49.872738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:49.873874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:49.875123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 410/834] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:49.880010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:49.889578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:49.917323 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a882c-b540-4560-8e90-d6cbb96f793d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.953603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:49.954872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:49.955353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:49.955896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:49.968996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:49.970855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:49.986781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0352a0-7d7f-4929-9bee-0250a10fa0f9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:49.989261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:49.990132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:49.991029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:49.991029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:49.991029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:49.991029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:49.996860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:49.997455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 425/835] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:49.999317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.023523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.023881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.024193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.024475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.025298 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:50.025607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.027039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:50.045696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 411/836] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:50.047431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.112469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cacde-bd2c-4b8d-bfbf-6792e06efad1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:50.117150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:50.151326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.152382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.152926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.153398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.154073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3341-e6e7-4205-9ab0-bf68aa0cbd27 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:50.154573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:50.155075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.156890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:50.174167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 426/837] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:50.175763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.191433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64d37-92c0-4927-907c-c6146b77dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.192440 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64d37-92c0-4927-907c-c6146b77dc52 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.192729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64d37-92c0-4927-907c-c6146b77dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.193087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64d37-92c0-4927-907c-c6146b77dc52 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/8a346babd29541b4ae699731bc801b8c/roles/d8b62a0f71124aa1bd3c62e2923db913` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.209968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64d37-92c0-4927-907c-c6146b77dc52 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=8a346babd29541b4ae699731bc801b8c, role_id=d8b62a0f71124aa1bd3c62e2923db913)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.211515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64d37-92c0-4927-907c-c6146b77dc52 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:50.227886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 412/838] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:23:50 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/8a346babd29541b4ae699731bc801b8c/roles/d8b62a0f71124aa1bd3c62e2923db913 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:23:50.234985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e091-abe8-4b8c-8068-fd66e8554e5a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.235338 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e091-abe8-4b8c-8068-fd66e8554e5a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.235556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e091-abe8-4b8c-8068-fd66e8554e5a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.237231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:50.248004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 413/839] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:50.252768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58b7a-b8e3-4e7a-ac60-b5cdb1315995 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.253090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58b7a-b8e3-4e7a-ac60-b5cdb1315995 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.253369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58b7a-b8e3-4e7a-ac60-b5cdb1315995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.288348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-66f58b7a-b8e3-4e7a-ac60-b5cdb1315995 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:50.290354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-66f58b7a-b8e3-4e7a-ac60-b5cdb1315995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:50.297574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0a983-6c30-405f-addb-f2a630e04652 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:50.338278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.339217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.339500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.339773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.349438 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.350863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:50.367452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:50.368486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:23:50.369527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:50.373599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 427/840] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:23:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:50.375017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.395713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 414/841] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:50.418006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58b7a-b8e3-4e7a-ac60-b5cdb1315995 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.474461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:50.504444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee2c2f-2326-436b-8228-fbb3cdb19be4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:50.518843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:50.544810 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58b7a-b8e3-4e7a-ac60-b5cdb1315995 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:50.548612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.549674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.550160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.550681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.551759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:50.552311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.554107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:50.578813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 428/842] 10.222.0.79 () {56 vars in 1135 bytes} [Fri May 27 09:23:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:50.580453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.591706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.593521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.594071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.594562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.595422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.597010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:50.609491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:50.610496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:50.611369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:50.618857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 415/843] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:50.620537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.701191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc9f65-ff0f-43a2-9eee-edb484ee3293 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:50.746227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aacd7e-68d1-4346-94ce-25362c87808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.746908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aacd7e-68d1-4346-94ce-25362c87808f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.747571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aacd7e-68d1-4346-94ce-25362c87808f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.747863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aacd7e-68d1-4346-94ce-25362c87808f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.750880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c96549-c9a4-4184-9709-163ad73f3a01 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:50.763679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:50.798275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:50.802992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.805018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.805505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.806013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.807439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:50.808345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.811325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:50.822420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 416/844] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:50.824169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.841027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aacd7e-68d1-4346-94ce-25362c87808f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.842534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aacd7e-68d1-4346-94ce-25362c87808f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:50.953786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b93d9-a6f4-4c30-bde6-c73e079bc4d6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:50.965910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 429/845] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:23:50.968094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aacd7e-68d1-4346-94ce-25362c87808f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:50.994344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:50.995019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:50.995304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:50.995585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:50.996291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:50.996599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:50.998025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:51.003685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 417/846] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:51.048944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:51.087596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aacd7e-68d1-4346-94ce-25362c87808f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:51.125993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:51.127096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:51.127524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:51.127955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:51.139537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:51.141886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:51.160911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:51.162044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:51.163150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:51.163150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:51.163150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:51.163150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:51.169169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 430/847] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:51.173962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:51.221692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:51.287467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e0b5-55a0-409d-8870-de485701abab None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:51.327428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:51.328096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:51.328378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:51.328653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:51.329401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:51.329703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:51.331072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:51.348238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 418/848] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:51.349619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:51.455719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f502595-6060-4073-931e-4bf3a510c7e9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:51.476947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:51.493541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:51.494365 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:51.494648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:51.494926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:51.503156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:51.504639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:51.520295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:51.521309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:51.522213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:51.522213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:51.522213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:51.522213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:51.522213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:51.522213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:51.522213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:51.522213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:51.526306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 431/849] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:51.527680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:51.627944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:51.634962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de149c85-5289-4c02-b06b-98ca77b6f878 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:51.671478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429fe3c-eb37-48bf-9d84-1fd602833acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:51.672495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429fe3c-eb37-48bf-9d84-1fd602833acd None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:51.673018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429fe3c-eb37-48bf-9d84-1fd602833acd None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:51.673527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429fe3c-eb37-48bf-9d84-1fd602833acd None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:51.674512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429fe3c-eb37-48bf-9d84-1fd602833acd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:51.675024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429fe3c-eb37-48bf-9d84-1fd602833acd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:51.676648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429fe3c-eb37-48bf-9d84-1fd602833acd None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:51.689862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 419/850] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:51.697383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:51.699121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79995d52-087d-4c13-b012-6aee97273739 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:51.699619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79995d52-087d-4c13-b012-6aee97273739 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:51.700208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79995d52-087d-4c13-b012-6aee97273739 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:51.702544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 420/851] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:51.707963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f183-4883-454e-aab7-abe3edd4a492 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:51.708524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f183-4883-454e-aab7-abe3edd4a492 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:51.709035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f183-4883-454e-aab7-abe3edd4a492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:51.727332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b2e6f183-4883-454e-aab7-abe3edd4a492 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:51.728802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b2e6f183-4883-454e-aab7-abe3edd4a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:51.800249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f274e-f1ad-4778-8d88-29d3ee506e2e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:51.809095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 421/852] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:51.828485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6f183-4883-454e-aab7-abe3edd4a492 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:51.840380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:51.841831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:51.842608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:51.843072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:51.844336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=113f9a9f11014b9ba3efe6781615d68b) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:51.845080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:51.846558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:51.855027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 432/853] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:51 2022] GET /identity/v3/role_assignments?user.id=113f9a9f11014b9ba3efe6781615d68b&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:51.943666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:51.957361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6f183-4883-454e-aab7-abe3edd4a492 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:51.994855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:51.995601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:51.996195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:51.996472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:51.997164 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:51.998586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:52.011778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:52.012816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:52.013709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 422/854] 10.222.0.79 () {56 vars in 1132 bytes} [Fri May 27 09:23:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:52.021836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:52.073113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:52.135476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbea31-7df6-4b0d-a69d-dbe762712c44 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:52.171579 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae89698-9c04-483b-ad33-90acee8c98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:52.172245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae89698-9c04-483b-ad33-90acee8c98ff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:52.172529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae89698-9c04-483b-ad33-90acee8c98ff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:52.172807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae89698-9c04-483b-ad33-90acee8c98ff None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:52.173536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae89698-9c04-483b-ad33-90acee8c98ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:52.173843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae89698-9c04-483b-ad33-90acee8c98ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:52.175210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae89698-9c04-483b-ad33-90acee8c98ff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:52.180190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 433/855] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:23:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:52.185779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:52.294032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc65f64-1388-4972-980a-cceee0cc80ec None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:52.329654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370edafc-17a9-4d4d-b29b-06527e0aa3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:52.330323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370edafc-17a9-4d4d-b29b-06527e0aa3ec None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:52.330603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370edafc-17a9-4d4d-b29b-06527e0aa3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:52.330876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370edafc-17a9-4d4d-b29b-06527e0aa3ec None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:52.331577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370edafc-17a9-4d4d-b29b-06527e0aa3ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:52.331880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370edafc-17a9-4d4d-b29b-06527e0aa3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:52.333272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370edafc-17a9-4d4d-b29b-06527e0aa3ec None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:52.338421 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 423/856] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:23:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:52.555344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6049b3-6c41-458f-94bc-1c36a1caab82 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:52.555714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6049b3-6c41-458f-94bc-1c36a1caab82 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:52.555914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6049b3-6c41-458f-94bc-1c36a1caab82 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:52.557570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 434/857] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:52.562968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572468-092a-4055-9a26-3469d2899047 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:52.563253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572468-092a-4055-9a26-3469d2899047 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:52.563533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2572468-092a-4055-9a26-3469d2899047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:52.580363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c2572468-092a-4055-9a26-3469d2899047 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:52.581573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c2572468-092a-4055-9a26-3469d2899047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:52.593594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:52.656935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 424/858] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:52.674987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6049b3-6c41-458f-94bc-1c36a1caab82 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:52.784353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6049b3-6c41-458f-94bc-1c36a1caab82 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:52.793771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:52.819343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870b5f1-3e77-4c6e-8281-a226edd4d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:52.820099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b5f1-3e77-4c6e-8281-a226edd4d36d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:52.820385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b5f1-3e77-4c6e-8281-a226edd4d36d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:52.820659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b5f1-3e77-4c6e-8281-a226edd4d36d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:52.831768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870b5f1-3e77-4c6e-8281-a226edd4d36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3870b5f1-3e77-4c6e-8281-a226edd4d36d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:52.839898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:52.840858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:23:52.841729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:52.845371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 435/859] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:23:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:52.847946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2572468-092a-4055-9a26-3469d2899047 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:52.957988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2572468-092a-4055-9a26-3469d2899047 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:52.993148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:52.993816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:52.994095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:52.994368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:52.995173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:52.995475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:52.996920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:53.010240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 425/860] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:23:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:53.011623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870b5f1-3e77-4c6e-8281-a226edd4d36d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:53.117396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870b5f1-3e77-4c6e-8281-a226edd4d36d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:53.159694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d4f36-46a8-4536-a647-f0c1581f5f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:53.160945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4f36-46a8-4536-a647-f0c1581f5f65 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:53.161459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4f36-46a8-4536-a647-f0c1581f5f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:53.161934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4f36-46a8-4536-a647-f0c1581f5f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:53.173969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d4f36-46a8-4536-a647-f0c1581f5f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:53.175700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d4f36-46a8-4536-a647-f0c1581f5f65 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3b1d4f36-46a8-4536-a647-f0c1581f5f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:53.193356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:53.194306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:53.195218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:53.195218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:53.195218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:53.195218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:53.197491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 436/861] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:53.204879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:53.217682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:53.308854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cfdf4-f7e3-4c8e-80bb-b39f6dae3d0f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:53.319651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1182bf-04a8-421a-901b-e6afe046beab None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:53.319938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1182bf-04a8-421a-901b-e6afe046beab None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:53.320215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1182bf-04a8-421a-901b-e6afe046beab None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:53.321901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 437/862] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:53.326923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ded5-dc7e-4409-a54d-337465c30f8c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:53.327215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ded5-dc7e-4409-a54d-337465c30f8c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:53.327494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ded5-dc7e-4409-a54d-337465c30f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:53.341129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:53.341792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:53.342596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:53.342870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:53.343594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:53.343899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:53.345380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:53.345507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8d06ded5-dc7e-4409-a54d-337465c30f8c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:53.346882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8d06ded5-dc7e-4409-a54d-337465c30f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:53.362639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 426/863] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:53.363322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:53.365118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:53.422087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 438/864] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:53.440592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ded5-dc7e-4409-a54d-337465c30f8c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:53.440972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:53.472048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f61d-2466-466e-912b-6229e291cb8d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:53.511813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:53.512906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:53.514557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:53.514918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:53.523868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:53.525621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:53.544212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:53.545242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:23:53.546240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:53.546785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ded5-dc7e-4409-a54d-337465c30f8c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:53.553233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 427/865] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:23:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:53.554694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:53.591388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ef86-924b-4d7c-bab9-e8e9682934d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:53.592158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ef86-924b-4d7c-bab9-e8e9682934d4 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:53.593032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ef86-924b-4d7c-bab9-e8e9682934d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:53.593318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ef86-924b-4d7c-bab9-e8e9682934d4 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:53.594311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25ef86-924b-4d7c-bab9-e8e9682934d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:53.596608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25ef86-924b-4d7c-bab9-e8e9682934d4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:53.616916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 439/866] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:23:53 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:23:53.681943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72733-c352-4b2e-9e40-c75f9a5a0f6f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:53.713272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:53.728529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:53.729259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:53.729546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:53.729825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:53.730678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:53.730990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:53.732459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:53.753343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 428/867] 10.222.0.79 () {56 vars in 1149 bytes} [Fri May 27 09:23:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:53.759241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ef86-924b-4d7c-bab9-e8e9682934d4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:53.778091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:53.875089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ef86-924b-4d7c-bab9-e8e9682934d4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:53.910330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b73850-203b-4941-9869-ba449c52fbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:53.910990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73850-203b-4941-9869-ba449c52fbea None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:53.911273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73850-203b-4941-9869-ba449c52fbea None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:53.911555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73850-203b-4941-9869-ba449c52fbea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:53.980502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b73850-203b-4941-9869-ba449c52fbea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:53.981907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b73850-203b-4941-9869-ba449c52fbea None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:53.994041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:54.100576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 440/868] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:53 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:23:54.102170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:54.196903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238618c-2813-4139-aad4-e8d5e7294bae None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.197198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238618c-2813-4139-aad4-e8d5e7294bae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.197484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238618c-2813-4139-aad4-e8d5e7294bae None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.198865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 441/869] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:54.203926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d7b6-05a9-4375-8919-942afd6ec35c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.204462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d7b6-05a9-4375-8919-942afd6ec35c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.204864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d7b6-05a9-4375-8919-942afd6ec35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.207426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18969af-2034-4608-8250-b06aa250fc2e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:54.225151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-36c0d7b6-05a9-4375-8919-942afd6ec35c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:54.226692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-36c0d7b6-05a9-4375-8919-942afd6ec35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:54.251415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:54.252657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.253205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.253702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.265890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:54.267741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:54.288563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:54.289599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:54.290500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:54.290500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:54.290500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:54.290500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:54.292928 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 429/870] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:54.306259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:54.310564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 442/871] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:54.332631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d7b6-05a9-4375-8919-942afd6ec35c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:54.350476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:54.392421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:54.423595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5533c0-a942-4d7e-ab16-d45a95f3f075 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:54.468717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:54.470251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.470820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.471399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.472281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:54.472744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:54.473243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d7b6-05a9-4375-8919-942afd6ec35c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:54.474465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:54.492242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 430/872] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:54.499066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:54.512556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:54.513360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.513645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.513956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.514622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:54.515984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:54.528248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:54.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:54.531046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 443/873] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:23:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:54.537550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:54.625695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:54.633760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845ca7e-2324-4e49-b549-04b7e30c1bef None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:54.669042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7327-92b4-4924-a463-6f5d053205b2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:54.669538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:54.670372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.670656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.670934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.672366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:54.678843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:54.681698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:54.697443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:54.698554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:54.699624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:54.699624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:54.699624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:54.699624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:54.699624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:54.699624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:54.699624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:54.699624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:54.703929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 431/874] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:54.704783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:54.713790 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:54.714718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.714854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.715070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.715834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:54.716149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:54.717591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:54.727272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 444/875] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:23:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:54.728140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:54.822951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066bd4-b6df-440b-ab68-1edf2761f886 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:54.835989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb142b-de9b-44b7-8f2b-2f8e1fd4b78f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:54.860557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:54.861420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.861782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.862392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.863444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:54.863754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:54.865959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:54.873935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c8af1-3883-4cb0-9097-1f7d9cc20a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:54.874611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c8af1-3883-4cb0-9097-1f7d9cc20a66 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.874897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c8af1-3883-4cb0-9097-1f7d9cc20a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.875175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c8af1-3883-4cb0-9097-1f7d9cc20a66 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.876341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c8af1-3883-4cb0-9097-1f7d9cc20a66 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:54.876816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c8af1-3883-4cb0-9097-1f7d9cc20a66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:54.878210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c8af1-3883-4cb0-9097-1f7d9cc20a66 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:54.887626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 445/876] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:23:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:54.887802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 432/877] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:54.887884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ab3b-065a-4116-9e15-2704de027640 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.887884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ab3b-065a-4116-9e15-2704de027640 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.887884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ab3b-065a-4116-9e15-2704de027640 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.888089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:54.888168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 446/878] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:54.892388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72f14e-61a3-4e38-8d23-09cdcb90f9b1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:54.892681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72f14e-61a3-4e38-8d23-09cdcb90f9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:54.893000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72f14e-61a3-4e38-8d23-09cdcb90f9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:54.912087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1f72f14e-61a3-4e38-8d23-09cdcb90f9b1 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:54.920581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f72f14e-61a3-4e38-8d23-09cdcb90f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:54.921696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:54.954603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:55.009274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 447/879] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:55.028516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f26b-8198-44bb-ac93-022e61848c54 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:55.028820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72f14e-61a3-4e38-8d23-09cdcb90f9b1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:55.068219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f7edd-8877-4d80-a2c5-58905e686d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:55.068915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7edd-8877-4d80-a2c5-58905e686d63 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:55.069200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7edd-8877-4d80-a2c5-58905e686d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:55.069648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f7edd-8877-4d80-a2c5-58905e686d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:55.070640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f7edd-8877-4d80-a2c5-58905e686d63 None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=8a346babd29541b4ae699731bc801b8c) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:55.070969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f7edd-8877-4d80-a2c5-58905e686d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:55.072456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f7edd-8877-4d80-a2c5-58905e686d63 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:55.085368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 433/880] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:23:54 2022] GET /identity/v3/role_assignments?user.id=8a346babd29541b4ae699731bc801b8c&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:55.162389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72f14e-61a3-4e38-8d23-09cdcb90f9b1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:55.201063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87ddf9-153c-4758-b67c-6d28cca77752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:55.202075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87ddf9-153c-4758-b67c-6d28cca77752 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:55.202545 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87ddf9-153c-4758-b67c-6d28cca77752 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:55.203052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87ddf9-153c-4758-b67c-6d28cca77752 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:55.204009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87ddf9-153c-4758-b67c-6d28cca77752 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:55.205597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87ddf9-153c-4758-b67c-6d28cca77752 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:55.223634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 448/881] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:23:55 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:23:55.954372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543a1f-1afd-4137-9815-8fe44bff4ce1 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:55.954916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543a1f-1afd-4137-9815-8fe44bff4ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:55.954916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543a1f-1afd-4137-9815-8fe44bff4ce1 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:55.956567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 434/882] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:55.961707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15751c-0880-4a35-8aef-5dae443d6a58 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:55.962397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15751c-0880-4a35-8aef-5dae443d6a58 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:55.962550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15751c-0880-4a35-8aef-5dae443d6a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:55.980292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5d15751c-0880-4a35-8aef-5dae443d6a58 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:55.981519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5d15751c-0880-4a35-8aef-5dae443d6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:55.999212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:56.059101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 449/883] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:56.082434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543a1f-1afd-4137-9815-8fe44bff4ce1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:56.169341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:56.192223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543a1f-1afd-4137-9815-8fe44bff4ce1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:56.226958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:56.227687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:56.227971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:56.228247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:56.228996 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:56.230376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:56.242273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:56.243314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:56.244797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 435/884] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:56.250029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15751c-0880-4a35-8aef-5dae443d6a58 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:56.352379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15751c-0880-4a35-8aef-5dae443d6a58 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:56.386184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:56.386851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:56.387134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:56.387409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:56.388109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:56.388469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:56.390488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:56.395449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 450/885] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:56.400960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:56.511171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14ff4-30fe-47db-9aa0-ded320af5a74 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:56.547341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:56.548016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:56.548298 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:56.548578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:56.549320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:56.549632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:56.550999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:56.556357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 436/886] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:56.562515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:56.577596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:56.664699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747abee-a0e6-4ca2-8388-b9ac39173c63 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:56.700056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423be43-7fc5-4ccb-9657-30968d6bb2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:56.700729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423be43-7fc5-4ccb-9657-30968d6bb2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:56.701039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423be43-7fc5-4ccb-9657-30968d6bb2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:56.701352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423be43-7fc5-4ccb-9657-30968d6bb2c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:56.702145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423be43-7fc5-4ccb-9657-30968d6bb2c4 None admin] RBAC: Adding query filter params (interface=public, service_id=5baf00b25dd246fca81cd388d32800cc, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:56.702458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423be43-7fc5-4ccb-9657-30968d6bb2c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:56.703836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423be43-7fc5-4ccb-9657-30968d6bb2c4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:56.712100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 451/887] 10.222.0.79 () {56 vars in 1251 bytes} [Fri May 27 09:23:56 2022] GET /identity/v3/endpoints?service_id=5baf00b25dd246fca81cd388d32800cc&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:56.717624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:56.727103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:56.826685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85547b-cc15-4958-b9b6-37425ccf21c2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:56.862090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76552845-7b30-4d95-b8fa-4048fa162e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:56.862763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552845-7b30-4d95-b8fa-4048fa162e74 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:56.863055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552845-7b30-4d95-b8fa-4048fa162e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:56.863334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76552845-7b30-4d95-b8fa-4048fa162e74 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:56.864020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76552845-7b30-4d95-b8fa-4048fa162e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:56.865508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76552845-7b30-4d95-b8fa-4048fa162e74 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:56.871814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 437/888] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:23:56 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:23:57.201628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb454-e84d-492f-ba51-9b83ddd24101 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.202467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb454-e84d-492f-ba51-9b83ddd24101 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.202914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb454-e84d-492f-ba51-9b83ddd24101 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.204669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 452/889] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:57.210387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378c4b3-5703-4ca0-9ccf-7ee9cf099fa8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.210844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378c4b3-5703-4ca0-9ccf-7ee9cf099fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.211034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378c4b3-5703-4ca0-9ccf-7ee9cf099fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.230950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d378c4b3-5703-4ca0-9ccf-7ee9cf099fa8 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:57.232633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d378c4b3-5703-4ca0-9ccf-7ee9cf099fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:57.303467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:57.309408 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 438/890] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:23:57.332024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eb454-e84d-492f-ba51-9b83ddd24101 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:57.418275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:57.432423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3119-34b9-4d22-8032-fedd057a86a4 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.433134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3119-34b9-4d22-8032-fedd057a86a4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.433641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3119-34b9-4d22-8032-fedd057a86a4 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.435666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 439/891] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:57.441646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a453-fddb-4174-91fa-b27041f80ba9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.442303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a453-fddb-4174-91fa-b27041f80ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.442797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a453-fddb-4174-91fa-b27041f80ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.450353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eb454-e84d-492f-ba51-9b83ddd24101 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:57.461603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a6a3a453-fddb-4174-91fa-b27041f80ba9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:57.463370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a6a3a453-fddb-4174-91fa-b27041f80ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:57.495667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5737b-fab3-43cc-a7ef-4bab4eb0e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:57.496592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5737b-fab3-43cc-a7ef-4bab4eb0e74a None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.497081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5737b-fab3-43cc-a7ef-4bab4eb0e74a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.497525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5737b-fab3-43cc-a7ef-4bab4eb0e74a None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.498434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5737b-fab3-43cc-a7ef-4bab4eb0e74a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:57.500163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5737b-fab3-43cc-a7ef-4bab4eb0e74a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:57.520100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 453/892] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:23:57 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:23:57.550984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 440/893] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:57.576879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5737b-fab3-43cc-a7ef-4bab4eb0e74a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:57.647503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5bb66-aca9-49f7-bb58-f4df33d08b2c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.647794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5bb66-aca9-49f7-bb58-f4df33d08b2c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.648449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5bb66-aca9-49f7-bb58-f4df33d08b2c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.650192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 441/894] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:57.656226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bb88c-e284-4397-875c-11796f9014cf None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.656868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bb88c-e284-4397-875c-11796f9014cf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.657361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bb88c-e284-4397-875c-11796f9014cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.675422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-891bb88c-e284-4397-875c-11796f9014cf None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:57.677021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-891bb88c-e284-4397-875c-11796f9014cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:57.710148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5737b-fab3-43cc-a7ef-4bab4eb0e74a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:57.754005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c884-5745-4955-bc4a-070ba2cb76d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:57.754738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c884-5745-4955-bc4a-070ba2cb76d9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.755188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c884-5745-4955-bc4a-070ba2cb76d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.755598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c884-5745-4955-bc4a-070ba2cb76d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.758396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:57.762088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 442/895] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:57.772211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87c884-5745-4955-bc4a-070ba2cb76d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ba87c884-5745-4955-bc4a-070ba2cb76d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:23:57.780425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:57.781459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:23:57.782337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:57.783386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 454/896] 10.222.0.79 () {56 vars in 1120 bytes} [Fri May 27 09:23:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:57.786373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bb88c-e284-4397-875c-11796f9014cf None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:57.792925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c884-5745-4955-bc4a-070ba2cb76d9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:57.847142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:57.896687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bb88c-e284-4397-875c-11796f9014cf None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:57.924625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c884-5745-4955-bc4a-070ba2cb76d9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:57.944010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:57.945253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.945773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.946261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.947119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:57.948706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:57.963149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:57.964198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:23:57.965103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:57.972703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:57.972703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:57.972703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:57.972703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:57.973090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:57.973090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:57.973424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 443/897] 10.222.0.79 () {56 vars in 1132 bytes} [Fri May 27 09:23:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:57.973895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:57.974762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:57.984524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 455/898] 10.222.0.79 () {56 vars in 1115 bytes} [Fri May 27 09:23:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:57.990100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:58.058552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:58.101098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add67477-fcf9-4424-88a0-01715c03e73d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.112234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd2644-2b8a-46d6-9c48-830a433ccf3e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.125004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:58.140788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.141902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.142407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.142907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:58.143923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:58.144553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:58.146150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:58.152061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 444/899] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:23:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:58.160194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:58.160359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.161571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.161875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.162165 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:58.176239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:58.178363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:58.203372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:58.204854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:58.205769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:58.205769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:58.205769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:58.205769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:58.210001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 456/900] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:58.211010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:58.285494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0393-a38c-4303-9ffc-47fba03b023d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.324751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b960e-3caf-4d74-a1ee-1d0fb8e68cf2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.328790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.329492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.329781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.330066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:58.330779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:58.331092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:58.332465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:58.339558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 445/901] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:23:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:58.341288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:58.346754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:58.370271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.371570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.372450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.373024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:58.373972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:58.374488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:58.376925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:58.394101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 457/902] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:58.400443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:58.409779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:58.466364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ba65e-0073-4c7e-8571-f7787bcfc8fa None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.502095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.502782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.503045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.503334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:58.504120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] RBAC: Adding query filter params (interface=public, service_id=22c5bf6e646142008330226fc8f47b65, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:58.504436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:58.505837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:58.509110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0b8c0-6990-4717-8204-fee59be10f93 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.515792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 446/903] 10.222.0.79 () {56 vars in 1251 bytes} [Fri May 27 09:23:58 2022] GET /identity/v3/endpoints?service_id=22c5bf6e646142008330226fc8f47b65&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:58.516808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:58.556455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.557304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.557590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.557876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:58.569112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:58.570637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:23:58.592968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:58.594054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:23:58.595055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:58.596908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 458/904] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:23:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:58.600238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:58.643637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:58.657260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65dd9c-b401-477d-bc91-19619d45955a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.672237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:58.697973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826b66d-fe8b-4500-a8c5-7f199fd1af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.698445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b66d-fe8b-4500-a8c5-7f199fd1af79 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.698737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b66d-fe8b-4500-a8c5-7f199fd1af79 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.699019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b66d-fe8b-4500-a8c5-7f199fd1af79 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:58.699719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826b66d-fe8b-4500-a8c5-7f199fd1af79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:58.701665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826b66d-fe8b-4500-a8c5-7f199fd1af79 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:58.715343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 447/905] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:23:58 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:23:58.740547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c273eae-5409-4339-be0b-0aee938b2d79 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.782031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.783130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.783657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.784155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:58.785289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:58.785847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:58.787683 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:58.809540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 459/906] 10.222.0.79 () {56 vars in 1149 bytes} [Fri May 27 09:23:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:23:58.815772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826b66d-fe8b-4500-a8c5-7f199fd1af79 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:58.927989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826b66d-fe8b-4500-a8c5-7f199fd1af79 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:58.974162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93d4f4-b476-4e11-8e25-77376b79f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:58.975100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d4f4-b476-4e11-8e25-77376b79f987 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:58.975544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d4f4-b476-4e11-8e25-77376b79f987 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:58.975972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d4f4-b476-4e11-8e25-77376b79f987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.024788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:59.049204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93d4f4-b476-4e11-8e25-77376b79f987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:59.050900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93d4f4-b476-4e11-8e25-77376b79f987 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:59.156603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 448/907] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:23:58 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:23:59.162441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:59.163358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc176579-88ff-4e35-a607-546e4b8d3a71 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.163646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc176579-88ff-4e35-a607-546e4b8d3a71 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.163940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc176579-88ff-4e35-a607-546e4b8d3a71 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.166489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 449/908] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:23:59.170912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1f892-51d2-43fc-8d45-992536fccbf9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.171194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1f892-51d2-43fc-8d45-992536fccbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.171468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1f892-51d2-43fc-8d45-992536fccbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.188118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bbf1f892-51d2-43fc-8d45-992536fccbf9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:59.189390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bbf1f892-51d2-43fc-8d45-992536fccbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:59.259721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:59.267360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 450/909] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:23:59.272776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09080-9a21-4b5d-a273-33731fe96857 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:59.288267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1f892-51d2-43fc-8d45-992536fccbf9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:59.312648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:59.313892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:59.315180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.315534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.315889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.335408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:59.337145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:23:59.355493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:59.356479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:59.357515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:23:59.357515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:23:59.357515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:23:59.357515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:59.361349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 460/910] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:59.362643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:59.418947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1f892-51d2-43fc-8d45-992536fccbf9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:59.469321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a969be-5092-48a6-b2cd-548b519bf05f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:59.470041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:59.471364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.472740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.473296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.474170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:59.475779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:59.492458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:59.493533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:23:59.494396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:23:59.497649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 451/911] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:23:59.503552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:59.512962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:59.514291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.514692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.515037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.515831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:59.516202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:59.517916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:59.527349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:59.537361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 461/912] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:59.538752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:59.591261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:59.642464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840d12-1236-443a-b731-6cb09c1a3575 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:59.659722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169c461-a7d6-456e-8058-8692d0e16d6c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:59.681502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:59.682488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.682964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.683422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.684348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:59.684895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:59.686551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:59.692020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 452/913] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:59.697663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:59.698265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:59.699346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.699854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.700649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.710989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:59.713774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:23:59.731126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:23:59.732050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:23:59.733028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:23:59.733028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:23:59.733028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:23:59.733028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:23:59.733028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:23:59.733028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:23:59.733028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:23:59.733028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:23:59.737030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 462/914] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:23:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:23:59.738304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:59.801867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:59.812722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09aa4a-b2d9-407e-96ef-ac94dec620f5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:59.846864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bfdab-d071-424a-b72c-e1f10078ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:59.847509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862397-18c7-4893-8f28-9081d43f349c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:23:59.847636 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bfdab-d071-424a-b72c-e1f10078ca8f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.847805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bfdab-d071-424a-b72c-e1f10078ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.848064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bfdab-d071-424a-b72c-e1f10078ca8f None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.848757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bfdab-d071-424a-b72c-e1f10078ca8f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:59.849092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bfdab-d071-424a-b72c-e1f10078ca8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:59.850446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bfdab-d071-424a-b72c-e1f10078ca8f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:59.851631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:23:59.861167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 453/915] 10.222.0.79 () {56 vars in 1114 bytes} [Fri May 27 09:23:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:59.862719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e78d-9a72-4aa2-ae5d-3240a250975c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.863004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e78d-9a72-4aa2-ae5d-3240a250975c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.863279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e78d-9a72-4aa2-ae5d-3240a250975c None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.864876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 454/916] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:23:59.865227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e78d-9a72-4aa2-ae5d-3240a250975c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:23:59.888450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e0102-b63e-4204-8110-49afeaf9e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:23:59.889750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0102-b63e-4204-8110-49afeaf9e673 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.890032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0102-b63e-4204-8110-49afeaf9e673 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.890308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0102-b63e-4204-8110-49afeaf9e673 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.891110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e0102-b63e-4204-8110-49afeaf9e673 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:23:59.891420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e0102-b63e-4204-8110-49afeaf9e673 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:23:59.892924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e0102-b63e-4204-8110-49afeaf9e673 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:23:59.910210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 463/917] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:23:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:23:59.910210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3275-bbfb-4006-a7d5-b8c2c240e2d2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:23:59.910210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3275-bbfb-4006-a7d5-b8c2c240e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:23:59.910210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3275-bbfb-4006-a7d5-b8c2c240e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:23:59.926188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4aba3275-bbfb-4006-a7d5-b8c2c240e2d2 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:23:59.927373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4aba3275-bbfb-4006-a7d5-b8c2c240e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:23:59.985252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e78d-9a72-4aa2-ae5d-3240a250975c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:00.006524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 464/918] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:23:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:00.007677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3275-bbfb-4006-a7d5-b8c2c240e2d2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:00.030080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a2aeb-4db5-4e9b-9078-a3b34187a5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:00.031004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2aeb-4db5-4e9b-9078-a3b34187a5e9 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:00.031497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2aeb-4db5-4e9b-9078-a3b34187a5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:00.031998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2aeb-4db5-4e9b-9078-a3b34187a5e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:00.033023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a2aeb-4db5-4e9b-9078-a3b34187a5e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:00.034689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a2aeb-4db5-4e9b-9078-a3b34187a5e9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:00.053492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 455/919] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:23:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:00.054552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a2aeb-4db5-4e9b-9078-a3b34187a5e9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:00.073512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:00.124783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:00.142562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3275-bbfb-4006-a7d5-b8c2c240e2d2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:00.188932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a2aeb-4db5-4e9b-9078-a3b34187a5e9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:00.193017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:00.194150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:00.194673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:00.195150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:00.196198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] RBAC: Adding query filter params (role.id=5425b2f010674b17b2c2b5c25f83c183, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=8a346babd29541b4ae699731bc801b8c) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:00.196694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:00.199074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:00.208857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 465/920] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:00 2022] GET /identity/v3/role_assignments?user.id=8a346babd29541b4ae699731bc801b8c&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=5425b2f010674b17b2c2b5c25f83c183 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:00.235845 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:00.236747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:00.237161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:00.237524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:00.238304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:00.239985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:00.253953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:00.255095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:00.255958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 456/921] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:24:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:00.261576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:00.392291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e3be3-c1a1-40be-b61a-5bbd9110750a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:00.407525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:00.432179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:00.433262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:00.433774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:00.434258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:00.435184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:00.436270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:00.437879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:00.443556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 466/922] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:24:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:00.448894 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:00.557985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4816a75-fb1e-4d6e-94a4-3ff5d6516ba7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:00.572904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:00.594502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:00.595187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:00.595473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:00.595753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:00.596469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:00.596779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:00.598186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:00.603936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 457/923] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:24:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:00.609914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:00.720080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772583e5-f1f3-4859-a6b6-6eacc28868b3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:00.756307 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bdda8-66b4-4002-895f-4dc1925b1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:00.756994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bdda8-66b4-4002-895f-4dc1925b1ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:00.757278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bdda8-66b4-4002-895f-4dc1925b1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:00.757553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bdda8-66b4-4002-895f-4dc1925b1ef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:00.758333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bdda8-66b4-4002-895f-4dc1925b1ef4 None admin] RBAC: Adding query filter params (interface=public, service_id=1c66734fd78e4b13ad845fc19cd3b866, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:00.758641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bdda8-66b4-4002-895f-4dc1925b1ef4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:00.760005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bdda8-66b4-4002-895f-4dc1925b1ef4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:00.765734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 467/924] 10.222.0.79 () {56 vars in 1251 bytes} [Fri May 27 09:24:00 2022] GET /identity/v3/endpoints?service_id=1c66734fd78e4b13ad845fc19cd3b866&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:00.771153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:00.876432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b06c49-9cc8-4b06-8270-4513a32618ab None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:00.914497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed92377-fdda-4ae0-ad18-4ec31fd7b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:00.915548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed92377-fdda-4ae0-ad18-4ec31fd7b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:00.916046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed92377-fdda-4ae0-ad18-4ec31fd7b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:00.916542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed92377-fdda-4ae0-ad18-4ec31fd7b1c3 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:00.917499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed92377-fdda-4ae0-ad18-4ec31fd7b1c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:00.919088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed92377-fdda-4ae0-ad18-4ec31fd7b1c3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:00.926550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 458/925] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:24:00 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:24:01.080991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769ba5-cb38-4a58-a53e-8ce02c01d613 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:01.081343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769ba5-cb38-4a58-a53e-8ce02c01d613 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:01.081564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769ba5-cb38-4a58-a53e-8ce02c01d613 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:01.083289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 468/926] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:01.089688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2474-b2a8-4fff-b893-f8006dda66ac None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:01.089984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2474-b2a8-4fff-b893-f8006dda66ac None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:01.090253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2474-b2a8-4fff-b893-f8006dda66ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:01.109994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-04ec2474-b2a8-4fff-b893-f8006dda66ac None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:01.111214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-04ec2474-b2a8-4fff-b893-f8006dda66ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:01.149216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:01.183452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 459/927] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:01.206309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2769ba5-cb38-4a58-a53e-8ce02c01d613 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:01.251863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:01.320923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2769ba5-cb38-4a58-a53e-8ce02c01d613 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:01.358978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:01.359799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:01.360083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:01.360364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:01.361056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:01.362429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:01.375423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:01.376560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:01.377653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 469/928] 10.222.0.79 () {56 vars in 1132 bytes} [Fri May 27 09:24:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:01.384710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec2474-b2a8-4fff-b893-f8006dda66ac None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:01.491460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec2474-b2a8-4fff-b893-f8006dda66ac None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:01.527847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:01.528917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:01.529453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:01.529927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:01.530822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:01.531334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:01.532920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:01.542665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 460/929] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:24:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:01.544210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:01.650734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06964-cdec-4800-babe-9b26f9432881 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:01.658421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:01.686040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6d63-9088-425c-96dd-1e2fa56f6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:01.686706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6d63-9088-425c-96dd-1e2fa56f6bea None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:01.686992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6d63-9088-425c-96dd-1e2fa56f6bea None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:01.687268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6d63-9088-425c-96dd-1e2fa56f6bea None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:01.687973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6d63-9088-425c-96dd-1e2fa56f6bea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:01.688283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6d63-9088-425c-96dd-1e2fa56f6bea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:01.689674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6d63-9088-425c-96dd-1e2fa56f6bea None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:01.694846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 470/930] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:24:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:01.700503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:01.738150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:01.807267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cfac0-594e-4ed5-810f-198cb7bb6fe0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:01.844100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d0ec6-e2aa-49db-840d-5e74ca9c45d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:01.845182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0ec6-e2aa-49db-840d-5e74ca9c45d4 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:01.845665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0ec6-e2aa-49db-840d-5e74ca9c45d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:01.846156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0ec6-e2aa-49db-840d-5e74ca9c45d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:01.847106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d0ec6-e2aa-49db-840d-5e74ca9c45d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:01.848721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d0ec6-e2aa-49db-840d-5e74ca9c45d4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:01.872988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 461/931] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:24:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:02.437773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999689-43c5-4936-ae83-81b64a352054 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:02.438801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999689-43c5-4936-ae83-81b64a352054 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:02.439304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999689-43c5-4936-ae83-81b64a352054 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:02.441191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 471/932] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:02.446546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7464-5db4-494c-a498-70d16c223a8a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:02.447075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7464-5db4-494c-a498-70d16c223a8a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:02.447558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7464-5db4-494c-a498-70d16c223a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:02.465484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1e9c7464-5db4-494c-a498-70d16c223a8a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:02.467510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1e9c7464-5db4-494c-a498-70d16c223a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:02.538538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd1e0-8812-4ad1-becf-b29479ff3a73 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:02.539256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd1e0-8812-4ad1-becf-b29479ff3a73 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:02.539739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd1e0-8812-4ad1-becf-b29479ff3a73 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:02.541580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 472/933] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:02.542287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 462/934] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:02.549957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bd109-cc5b-4955-9b25-21517bc031d3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:02.550486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bd109-cc5b-4955-9b25-21517bc031d3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:02.550970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bd109-cc5b-4955-9b25-21517bc031d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:02.567880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2f3bd109-cc5b-4955-9b25-21517bc031d3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:02.569415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2f3bd109-cc5b-4955-9b25-21517bc031d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:02.571356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7464-5db4-494c-a498-70d16c223a8a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:02.600354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:02.640064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 473/935] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:02.667990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bd109-cc5b-4955-9b25-21517bc031d3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:02.699516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7464-5db4-494c-a498-70d16c223a8a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:02.744862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:02.745536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:02.745824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:02.746106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:02.746827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:02.748727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:02.750150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING keystone.server.flask.common [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 09:24:02.772422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:02.774643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.sql.core [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:24:02.774643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 09:24:02.774643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [parameters: {'id': 'd741b91a536d45738e6ac195b976450d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 09:24:02.774643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:24:02.777466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bd109-cc5b-4955-9b25-21517bc031d3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d741b91a536d45738e6ac195b976450d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d741b91a536d45738e6ac195b976450d. May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application conn.query(q) May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:24:02.784447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application result.read() May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 09:24:02.785336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application next(self.gen) May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application yield resource May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application next(self.gen) May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise self.value May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application session.commit() May 27 09:24:02.786309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.session.flush() May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application compat.raise_( May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:24:02.787218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:24:02.788204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application conn.query(q) May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application result.read() May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:24:02.794775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [parameters: {'id': 'd741b91a536d45738e6ac195b976450d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:02.796922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:02.798797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d741b91a536d45738e6ac195b976450d. May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 463/936] 10.222.0.79 () {60 vars in 1140 bytes} [Fri May 27 09:24:02 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:02.800938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:02.827054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e80d9e-07a1-42e2-80c1-27ad7d5b6b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:02.828288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80d9e-07a1-42e2-80c1-27ad7d5b6b06 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:02.828773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80d9e-07a1-42e2-80c1-27ad7d5b6b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:02.829304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80d9e-07a1-42e2-80c1-27ad7d5b6b06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:02.842459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e80d9e-07a1-42e2-80c1-27ad7d5b6b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f0e80d9e-07a1-42e2-80c1-27ad7d5b6b06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:02.853940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:02.854933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:02.855784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:02.863438 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 474/937] 10.222.0.79 () {56 vars in 1120 bytes} [Fri May 27 09:24:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:02.864104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e80d9e-07a1-42e2-80c1-27ad7d5b6b06 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:02.902710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:02.935107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef3a98-a1a3-4743-93c8-032c7affee2f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:02.978062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:02.979058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:02.979350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:02.979630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:02.988556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:02.991643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:02.993099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e80d9e-07a1-42e2-80c1-27ad7d5b6b06 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:24:03.012644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:03.014235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:03.015134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:24:03.015134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:24:03.015134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:24:03.015134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:24:03.015134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:24:03.015134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:24:03.015134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:03.015134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:03.022759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 464/938] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:03.024061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.034495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.035182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.035516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.035799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.036551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:03.036875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.038408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.052445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 475/939] 10.222.0.79 () {56 vars in 1115 bytes} [Fri May 27 09:24:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:03.053712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.090577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:03.167609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d0a6-4c28-4dab-ba32-00c9637cccf7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.172430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b81eb-bf25-4593-b7d9-812edd108969 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.207739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.208534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.208866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.209457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.215167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab511fce-25b9-433e-b889-32bf125149f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.216090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511fce-25b9-433e-b889-32bf125149f2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.216613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511fce-25b9-433e-b889-32bf125149f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.217120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511fce-25b9-433e-b889-32bf125149f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.218617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab511fce-25b9-433e-b889-32bf125149f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:03.219628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab511fce-25b9-433e-b889-32bf125149f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.221501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.221849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab511fce-25b9-433e-b889-32bf125149f2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.222934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.223998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:03.243568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:03.244547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:03.245495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:03.245495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:03.245495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:03.245495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:03.256863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 476/941] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:03.256863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.257133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 465/941] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:03.257133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcc64-9774-4197-a69b-b94622cf5cee None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.257133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcc64-9774-4197-a69b-b94622cf5cee None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.257133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcc64-9774-4197-a69b-b94622cf5cee None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.257133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 466/942] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:03.261637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124acee-7075-438a-8c7b-e01e21884efd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.261930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124acee-7075-438a-8c7b-e01e21884efd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.262212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124acee-7075-438a-8c7b-e01e21884efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.281595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d124acee-7075-438a-8c7b-e01e21884efd None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:03.283813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d124acee-7075-438a-8c7b-e01e21884efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:03.344904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:03.375222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3b98-fbc8-4d25-9efb-07a187b89e57 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.392992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 467/943] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:03.418535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124acee-7075-438a-8c7b-e01e21884efd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.424425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.425157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.425441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.425714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.426449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:03.426753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.428163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.446485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 477/944] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:03.447886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.551271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124acee-7075-438a-8c7b-e01e21884efd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.567369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0809336-bc73-4a92-859b-e8c056552037 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.578975 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:03.595747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.596912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.597294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.598362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.599029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.600420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:03.622431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:03.623711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:03.624604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:03.626671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.627395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 468/945] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:03.627897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.628187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.628458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.634974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.636674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:03.651529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.654700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:24:03.675920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:03.677068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:24:03.678103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:03.680751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 478/946] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:03.686827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.761879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05ce76-b98c-4b50-8fe1-20564b9b855b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.802729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.803582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b464cb-8724-4d26-bc8e-55ee20882760 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.804004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.804509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.805044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.805957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:03.806486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.808066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.818885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 469/947] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:03.820057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.847326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.848394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.848729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.849040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.850176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:03.850486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.852637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.881444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 479/948] 10.222.0.79 () {56 vars in 1149 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:03.882668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:03.887610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:03.938540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078931c-2b5b-4d8e-80c5-e1de569a19b7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.942648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:03.980447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:03.981543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:03.981981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:03.982956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:03.983833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:03.984321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:03.986028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:03.997244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 470/949] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:03.998156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4929-7425-4c1a-8265-efb146f595ff None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:03.998669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:04.035041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.035971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.036362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.036768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.049040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.050455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:04.070269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:04.071430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:04.072460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:04.072460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:04.072460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:04.072460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:04.077775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 480/950] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:04.079031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:04.115919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f8fa7-3586-4f2a-b680-4001e77f17ce None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:04.134417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:04.155117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaa0b5-f5ff-46cf-b325-49cef6d9c56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.155782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa0b5-f5ff-46cf-b325-49cef6d9c56e None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.156074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa0b5-f5ff-46cf-b325-49cef6d9c56e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.156668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa0b5-f5ff-46cf-b325-49cef6d9c56e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.157452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaa0b5-f5ff-46cf-b325-49cef6d9c56e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.158816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaa0b5-f5ff-46cf-b325-49cef6d9c56e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.185026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 471/951] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:24:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:04.187246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fff1f-4b76-4d03-ba8e-89504e98c002 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.187534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fff1f-4b76-4d03-ba8e-89504e98c002 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.187922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fff1f-4b76-4d03-ba8e-89504e98c002 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.194483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 472/952] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:04.195982 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ff83-464e-4ad9-854c-1dbf748f9fd4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.196409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ff83-464e-4ad9-854c-1dbf748f9fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.196745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ff83-464e-4ad9-854c-1dbf748f9fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.198721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112085f-6b9d-4e52-8015-37ce1e9805c3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:04.202403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:04.215910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3471ff83-464e-4ad9-854c-1dbf748f9fd4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:04.217237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3471ff83-464e-4ad9-854c-1dbf748f9fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:04.250882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.252101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.252648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.253222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.254357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:04.255058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.256733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.276129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 481/953] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:04.277945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:04.308993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 473/954] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:04.335807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471ff83-464e-4ad9-854c-1dbf748f9fd4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:04.411205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fc14-5e03-4378-86ce-5edbe91937b2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:04.454775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.455835 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.455835 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.456163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.466288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.468029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.472415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471ff83-464e-4ad9-854c-1dbf748f9fd4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:04.473974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:24:04.485033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:04.485970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:04.487096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:24:04.487096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:24:04.487096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:24:04.487096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:24:04.487096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:24:04.487096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:24:04.487096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:04.487096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:04.487636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 482/955] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:04.493697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:04.522666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.523517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.523849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.524073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:04.524232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.525356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.527396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:04.543391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:04.545993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:04.547872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 474/956] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:04.554219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:04.616946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d193-26e7-40c5-a76e-eaba955b40bd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:04.653832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.654907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.655388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.655864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.656881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:04.657412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.659050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.659161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae0b5e-e34a-45fa-9940-408cb72ad80c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:04.676946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 483/957] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:04.678382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:04.695624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f854e-2a87-4c40-a644-236f565280de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.696300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f854e-2a87-4c40-a644-236f565280de None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.696636 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f854e-2a87-4c40-a644-236f565280de None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.697019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f854e-2a87-4c40-a644-236f565280de None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.697720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f854e-2a87-4c40-a644-236f565280de None admin] RBAC: Adding query filter params (name=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:04.698077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f854e-2a87-4c40-a644-236f565280de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.699502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f854e-2a87-4c40-a644-236f565280de None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.709529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 475/958] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:24:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:04.710373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f854e-2a87-4c40-a644-236f565280de None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:04.743984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:04.766729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:04.786799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcf18-9e51-41f0-9510-ee4e5d50ee35 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:04.821569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499c0b2-d01e-47d7-986b-48cb8a8d3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.822794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c0b2-d01e-47d7-986b-48cb8a8d3105 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.822904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f854e-2a87-4c40-a644-236f565280de None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:04.823443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c0b2-d01e-47d7-986b-48cb8a8d3105 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.823913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c0b2-d01e-47d7-986b-48cb8a8d3105 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/8a346babd29541b4ae699731bc801b8c/roles/5425b2f010674b17b2c2b5c25f83c183` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.826499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499c0b2-d01e-47d7-986b-48cb8a8d3105 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=8a346babd29541b4ae699731bc801b8c, role_id=5425b2f010674b17b2c2b5c25f83c183)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.828158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499c0b2-d01e-47d7-986b-48cb8a8d3105 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.853106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 484/959] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:24:04 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/8a346babd29541b4ae699731bc801b8c/roles/5425b2f010674b17b2c2b5c25f83c183 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:24:04.868702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aac7d9-6af4-4298-8c8d-ca0e3c23e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:04.869434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac7d9-6af4-4298-8c8d-ca0e3c23e992 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:04.869762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac7d9-6af4-4298-8c8d-ca0e3c23e992 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:04.870048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac7d9-6af4-4298-8c8d-ca0e3c23e992 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:04.870781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aac7d9-6af4-4298-8c8d-ca0e3c23e992 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:04.871090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aac7d9-6af4-4298-8c8d-ca0e3c23e992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:04.872556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aac7d9-6af4-4298-8c8d-ca0e3c23e992 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:04.879073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 476/960] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:24:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:05.621526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99497ec-7c4d-48c4-b239-0fd06344680e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:05.622056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99497ec-7c4d-48c4-b239-0fd06344680e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:05.622056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99497ec-7c4d-48c4-b239-0fd06344680e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:05.624182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 485/961] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:05.629721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4da66-53a5-4ac6-b758-dceecf64cbea None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:05.630141 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4da66-53a5-4ac6-b758-dceecf64cbea None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:05.630313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4da66-53a5-4ac6-b758-dceecf64cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:05.647173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a0c4da66-53a5-4ac6-b758-dceecf64cbea None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:05.648357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a0c4da66-53a5-4ac6-b758-dceecf64cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:05.721973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 477/962] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:05.746250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99497ec-7c4d-48c4-b239-0fd06344680e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:05.848975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99497ec-7c4d-48c4-b239-0fd06344680e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:05.884968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:05.885933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:05.886413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:05.886883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:05.887790 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:05.889491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:05.891065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING keystone.server.flask.common [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 09:24:05.904718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.sql.core [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:24:05.904718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 09:24:05.904718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [parameters: {'user_id': 'cfaf26423bac4003ac3cfea5bf222206', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 09:24:05.904718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80149) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application conn.query(q) May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result.read() May 27 09:24:05.922587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:24:05.923529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application next(self.gen) May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application yield resource May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application next(self.gen) May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise self.value May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application session.commit() May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:24:05.924506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.session.flush() May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application compat.raise_( May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:24:05.925494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:24:05.926416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application conn.query(q) May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result.read() May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:24:05.927282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cfaf26423bac4003ac3cfea5bf222206', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:05.928139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 09:24:05.930377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 09:24:05.932485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 09:24:05.932485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 09:24:05.932485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:24:05.932485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:24:05.932485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 09:24:05.932485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:05.935174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 486/963] 10.222.0.79 () {60 vars in 1131 bytes} [Fri May 27 09:24:05 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:05.941951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4da66-53a5-4ac6-b758-dceecf64cbea None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:05.968656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:06.051872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4da66-53a5-4ac6-b758-dceecf64cbea None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:06.091188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee6942-aad3-494d-9d66-23b8bb8a42a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:06.092984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6942-aad3-494d-9d66-23b8bb8a42a5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:06.093469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6942-aad3-494d-9d66-23b8bb8a42a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:06.093953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6942-aad3-494d-9d66-23b8bb8a42a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:06.102237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee6942-aad3-494d-9d66-23b8bb8a42a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:06.103928 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee6942-aad3-494d-9d66-23b8bb8a42a5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-81ee6942-aad3-494d-9d66-23b8bb8a42a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:24:06.119546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:06.120535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:24:06.121535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:06.124255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 478/964] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:24:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:06.132924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:06.141379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:06.235703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e97702-38d8-4a44-9b44-456c45363b84 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:06.270074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f543-0783-44d1-8ab1-c19b0dbf34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:06.270743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f543-0783-44d1-8ab1-c19b0dbf34dc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:06.271020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f543-0783-44d1-8ab1-c19b0dbf34dc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:06.271296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f543-0783-44d1-8ab1-c19b0dbf34dc None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:06.272095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f543-0783-44d1-8ab1-c19b0dbf34dc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:06.272396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f543-0783-44d1-8ab1-c19b0dbf34dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:06.274068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f543-0783-44d1-8ab1-c19b0dbf34dc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:06.316368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 487/965] 10.222.0.79 () {56 vars in 1101 bytes} [Fri May 27 09:24:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:06.487175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8bc5b-df70-4ec7-bfe8-f9c55ae475f1 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:06.487723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8bc5b-df70-4ec7-bfe8-f9c55ae475f1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:06.488003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8bc5b-df70-4ec7-bfe8-f9c55ae475f1 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:06.489673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 479/966] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:06.495325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af5ad-14a5-4321-aadf-1f32c305984b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:06.495623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af5ad-14a5-4321-aadf-1f32c305984b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:06.495911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af5ad-14a5-4321-aadf-1f32c305984b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:06.515352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a49af5ad-14a5-4321-aadf-1f32c305984b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:06.516933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a49af5ad-14a5-4321-aadf-1f32c305984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:06.581812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:06.595410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 488/967] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:06.617120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8bc5b-df70-4ec7-bfe8-f9c55ae475f1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:06.705215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:06.722914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8bc5b-df70-4ec7-bfe8-f9c55ae475f1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:06.757360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:06.758074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:06.758348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:06.758614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:06.759252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:06.760625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:06.773060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:06.774083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:06.774974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:06.776901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 480/968] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:24:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:06.780600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af5ad-14a5-4321-aadf-1f32c305984b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:06.881651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af5ad-14a5-4321-aadf-1f32c305984b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:06.915160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:06.915828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:06.916113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:06.916394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:06.917145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:06.917458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:06.918832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:06.928796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 489/969] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:24:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:06.930329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:07.038146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240857d6-ae85-475f-951c-52182db4a934 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:07.082046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eec47-2721-48aa-8116-2aff65a62204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:07.082687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eec47-2721-48aa-8116-2aff65a62204 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.082995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eec47-2721-48aa-8116-2aff65a62204 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.083256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eec47-2721-48aa-8116-2aff65a62204 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.083974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eec47-2721-48aa-8116-2aff65a62204 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:07.084368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eec47-2721-48aa-8116-2aff65a62204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:07.085681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eec47-2721-48aa-8116-2aff65a62204 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:07.095808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 481/970] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:24:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:07.097413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:07.139808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31b4e-63df-4a1b-9e99-95cb73168029 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.140178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31b4e-63df-4a1b-9e99-95cb73168029 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.140506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31b4e-63df-4a1b-9e99-95cb73168029 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.142099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 482/971] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:07.146872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc1c9-0162-4195-be96-6ed5594d553b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.147161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc1c9-0162-4195-be96-6ed5594d553b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.147443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc1c9-0162-4195-be96-6ed5594d553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.156583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:07.164174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-58ebc1c9-0162-4195-be96-6ed5594d553b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:07.165380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-58ebc1c9-0162-4195-be96-6ed5594d553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:07.173349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:07.205446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3962c-b336-41b3-80b7-8f584e0d16ea None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:07.238803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 483/972] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:07.239777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:07.240217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd542-a8bd-49f4-aca6-d9289b3a9e83 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.240437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.240538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd542-a8bd-49f4-aca6-d9289b3a9e83 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.240726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.240853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bd542-a8bd-49f4-aca6-d9289b3a9e83 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.241039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.241837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] RBAC: Adding query filter params (interface=admin, service_id=1c66734fd78e4b13ad845fc19cd3b866, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:07.245860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:07.245998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 484/973] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:07.246098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:07.247246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d4ec-496c-46a6-bdd3-91da32803c14 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.247514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d4ec-496c-46a6-bdd3-91da32803c14 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.248361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d4ec-496c-46a6-bdd3-91da32803c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.249659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 490/974] 10.222.0.79 () {56 vars in 1249 bytes} [Fri May 27 09:24:07 2022] GET /identity/v3/endpoints?service_id=1c66734fd78e4b13ad845fc19cd3b866&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:07.254676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:07.268505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3168d4ec-496c-46a6-bdd3-91da32803c14 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:07.269735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3168d4ec-496c-46a6-bdd3-91da32803c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:07.340868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 485/975] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:07.340868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d4ec-496c-46a6-bdd3-91da32803c14 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:07.364732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1f0d8-bc72-48e7-8b4e-02e3c1418138 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:07.381487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:07.398405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e9d45-e8da-46be-b1aa-b9d9a24d842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:07.399063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e9d45-e8da-46be-b1aa-b9d9a24d842d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.399345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e9d45-e8da-46be-b1aa-b9d9a24d842d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.399617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e9d45-e8da-46be-b1aa-b9d9a24d842d None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.400283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e9d45-e8da-46be-b1aa-b9d9a24d842d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:07.401671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e9d45-e8da-46be-b1aa-b9d9a24d842d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:07.405835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:07.408136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 491/976] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:24:07 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:24:07.408926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e9d45-e8da-46be-b1aa-b9d9a24d842d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:07.442957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d4ec-496c-46a6-bdd3-91da32803c14 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:07.484910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beead4-c198-4017-a678-bf2a48302203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:07.485753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beead4-c198-4017-a678-bf2a48302203 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.486041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beead4-c198-4017-a678-bf2a48302203 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.486318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beead4-c198-4017-a678-bf2a48302203 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.499527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beead4-c198-4017-a678-bf2a48302203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-e6beead4-c198-4017-a678-bf2a48302203 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:07.508096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:07.509203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:07.510072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 486/977] 10.222.0.79 () {56 vars in 1120 bytes} [Fri May 27 09:24:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:07.515402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beead4-c198-4017-a678-bf2a48302203 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:07.532644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e9d45-e8da-46be-b1aa-b9d9a24d842d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:07.569609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cd34f-0524-44a6-bbcd-990f82fa93c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:07.570195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd34f-0524-44a6-bbcd-990f82fa93c3 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.570475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd34f-0524-44a6-bbcd-990f82fa93c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.570756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd34f-0524-44a6-bbcd-990f82fa93c3 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.571481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cd34f-0524-44a6-bbcd-990f82fa93c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:07.572896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cd34f-0524-44a6-bbcd-990f82fa93c3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:07.589538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 492/978] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:24:07 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:07.629640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beead4-c198-4017-a678-bf2a48302203 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:07.663749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:07.678146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:07.678838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.679132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.679415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.680171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:07.680472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:07.681949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:07.697395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 487/979] 10.222.0.79 () {56 vars in 1115 bytes} [Fri May 27 09:24:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:07.698660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cd34f-0524-44a6-bbcd-990f82fa93c3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:07.746477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:07.808997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cd34f-0524-44a6-bbcd-990f82fa93c3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:07.844510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:07.845261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:07.845549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:07.845828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:07.856614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:07.858623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:07.876234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:07.877430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:07.878345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:07.878345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:07.878345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:07.878345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:07.878345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 493/980] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:07.884241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:07.986226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6360b7-aa45-48ed-800d-494ef7ad1e9d None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:08.019889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:08.020557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:08.020857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:08.021145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:08.021862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:08.022170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:08.023535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:08.039844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 488/981] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:08.041468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:08.137609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:08.145079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b475d3-9dc3-47e9-bf1c-df054e9a6756 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:08.180199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:08.181240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:08.181654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:08.182032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:08.189261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:08.190832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:24:08.205894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:08.206969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:24:08.207944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:08.209063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 494/982] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:24:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:08.213532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:08.266095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:08.323052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0612a-27c0-4898-84c2-3ef20ab8c2cf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:08.356572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:08.357808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:08.358094 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:08.358375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:08.359207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:08.359517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:08.360961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:08.378136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 489/983] 10.222.0.79 () {56 vars in 1149 bytes} [Fri May 27 09:24:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:08.383484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:08.485951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f4ea-727a-4b80-87e5-3de43a74680b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:08.519139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8a537-31a1-4c8b-8229-322acaf0f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:08.519784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a537-31a1-4c8b-8229-322acaf0f87e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:08.520067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a537-31a1-4c8b-8229-322acaf0f87e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:08.520344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a537-31a1-4c8b-8229-322acaf0f87e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:08.544950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:08.590669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8a537-31a1-4c8b-8229-322acaf0f87e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:08.592731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8a537-31a1-4c8b-8229-322acaf0f87e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:08.693952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 495/984] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:24:08.695366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:08.795876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0eda8-c7d6-4923-baa3-8cfcd0d1ccb0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:08.804986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:08.830855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:08.831728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:08.832078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:08.832427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:08.842678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:08.844181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:08.861132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:08.862233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:08.863363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:08.863363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:08.863363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:08.863363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:08.864229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 490/985] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:08.869707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8a537-31a1-4c8b-8229-322acaf0f87e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:08.923351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:08.970413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8a537-31a1-4c8b-8229-322acaf0f87e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:09.004615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:09.005316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.005604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.005886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.006602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:09.006912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:09.008272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:09.024559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 496/986] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:09.026172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:09.134859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328e3b8-f6a9-4967-8018-41d2aee6c410 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:09.168553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:09.169913 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.170206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.170483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.177261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:09.178699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:24:09.192862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:09.193791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:09.194716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 491/987] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:09.201255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:09.307282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8696-0b59-47c3-b4cd-d5b5315bef7e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:09.321928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:09.343018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575e815-d016-4013-8899-faa5ba074c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:09.343695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e815-d016-4013-8899-faa5ba074c41 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.343994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e815-d016-4013-8899-faa5ba074c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.344261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e815-d016-4013-8899-faa5ba074c41 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.345069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575e815-d016-4013-8899-faa5ba074c41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:09.345385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575e815-d016-4013-8899-faa5ba074c41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:09.346833 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575e815-d016-4013-8899-faa5ba074c41 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:09.364355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 497/988] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:09.366005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:09.389753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:09.472513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062c3b9-695c-421e-986e-2e243ac21661 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:09.509924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76231a-2eec-4090-83dc-a04a05795669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:09.510583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76231a-2eec-4090-83dc-a04a05795669 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.510867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76231a-2eec-4090-83dc-a04a05795669 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.511145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76231a-2eec-4090-83dc-a04a05795669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.511974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76231a-2eec-4090-83dc-a04a05795669 None admin] RBAC: Adding query filter params (role.id=5425b2f010674b17b2c2b5c25f83c183, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=8a346babd29541b4ae699731bc801b8c) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:09.512288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76231a-2eec-4090-83dc-a04a05795669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:09.513775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76231a-2eec-4090-83dc-a04a05795669 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:09.519971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 492/989] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:09 2022] GET /identity/v3/role_assignments?user.id=8a346babd29541b4ae699731bc801b8c&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=5425b2f010674b17b2c2b5c25f83c183 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:09.659366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba39ec-76ec-40e6-a431-5e8019506f91 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.659665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba39ec-76ec-40e6-a431-5e8019506f91 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.659851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba39ec-76ec-40e6-a431-5e8019506f91 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.661480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 498/990] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:09.667093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92c61-0e75-4bda-bc34-c472df6d4db0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.667382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92c61-0e75-4bda-bc34-c472df6d4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.667661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92c61-0e75-4bda-bc34-c472df6d4db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.685847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-09c92c61-0e75-4bda-bc34-c472df6d4db0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:09.687087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-09c92c61-0e75-4bda-bc34-c472df6d4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:09.763457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 493/991] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:09.786254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba39ec-76ec-40e6-a431-5e8019506f91 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:09.802392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2c67e-000f-4e2a-9540-980e13f6772f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.802714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2c67e-000f-4e2a-9540-980e13f6772f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.803398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2c67e-000f-4e2a-9540-980e13f6772f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.804937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 494/992] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:09.809674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c8f2-5189-44af-929a-d949870e9e2d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.809994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c8f2-5189-44af-929a-d949870e9e2d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.810283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c8f2-5189-44af-929a-d949870e9e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.827095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-17a9c8f2-5189-44af-929a-d949870e9e2d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:09.828294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-17a9c8f2-5189-44af-929a-d949870e9e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:09.838740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:09.895163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba39ec-76ec-40e6-a431-5e8019506f91 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:09.901229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 495/993] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:09.924870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9c8f2-5189-44af-929a-d949870e9e2d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:09.933178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:09.934236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.934745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.935379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.936376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:09.937847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:09.950376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:09.952042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:09.953383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 499/994] 10.222.0.79 () {56 vars in 1126 bytes} [Fri May 27 09:24:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:09.957979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:10.001390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:10.035704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9c8f2-5189-44af-929a-d949870e9e2d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:10.067962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc14f7-b9fd-417a-8866-aa2edb35efa5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:10.071754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:10.072598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:10.072891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:10.073172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:10.073828 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:10.075192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:10.088071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:10.089355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:10.090267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 496/995] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:10.095681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:10.108427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:10.112157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:10.112846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:10.113193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:10.113471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:10.114175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:10.114478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:10.115854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:10.120818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 500/996] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:24:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:10.126367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:10.206101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb5857-b623-4d92-ae9d-fb5db6e75a8f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:10.232812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6043c-9b59-4e61-9a28-b7e87c103576 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:10.234384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:10.244224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:10.245163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:10.245451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:10.245730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:10.246434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:10.246741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:10.248346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:10.258067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 497/997] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:24:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:10.259037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:10.272989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:10.273703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:10.273989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:10.274268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:10.274972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:10.275285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:10.276666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:10.282615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 501/998] 10.222.0.79 () {56 vars in 1122 bytes} [Fri May 27 09:24:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:10.287997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:10.345515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:10.378336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9ecd3-2562-45c1-b02f-bfcae81a3561 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:10.392855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812fb55-a028-42d9-8635-63d15979154e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:10.416446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:10.417140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:10.417577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:10.417870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:10.418903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:10.419506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:10.421072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:10.427846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 498/999] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:24:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:10.430184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb33b-2a7f-4f1b-ae61-18701d6671f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:10.430847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb33b-2a7f-4f1b-ae61-18701d6671f3 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:10.431133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb33b-2a7f-4f1b-ae61-18701d6671f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:10.431416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb33b-2a7f-4f1b-ae61-18701d6671f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:10.432185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fb33b-2a7f-4f1b-ae61-18701d6671f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:10.433409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:10.433658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fb33b-2a7f-4f1b-ae61-18701d6671f3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:10.460947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 502/1000] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:24:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:24:10.551571 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bfb33-98eb-4ded-9b73-0ce7d1310873 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:10.590068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:10.596621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ef75b-3b6a-4f0d-ad46-a5b290d200bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:10.597423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef75b-3b6a-4f0d-ad46-a5b290d200bb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:10.597772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef75b-3b6a-4f0d-ad46-a5b290d200bb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:10.598115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef75b-3b6a-4f0d-ad46-a5b290d200bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:10.598974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ef75b-3b6a-4f0d-ad46-a5b290d200bb None admin] RBAC: Adding query filter params (interface=public, service_id=c20ac46329d146ff818e1475a370e2ae, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:10.599356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ef75b-3b6a-4f0d-ad46-a5b290d200bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:10.600802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ef75b-3b6a-4f0d-ad46-a5b290d200bb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:10.611187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 499/1001] 10.222.0.79 () {56 vars in 1251 bytes} [Fri May 27 09:24:10 2022] GET /identity/v3/endpoints?service_id=c20ac46329d146ff818e1475a370e2ae&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:10.612590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb33b-2a7f-4f1b-ae61-18701d6671f3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:10.646006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:10.726498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb33b-2a7f-4f1b-ae61-18701d6671f3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:10.761742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c14ace-888e-47db-9c4e-6c51257abb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:10.762498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c14ace-888e-47db-9c4e-6c51257abb4b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:10.762850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c14ace-888e-47db-9c4e-6c51257abb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:10.763225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c14ace-888e-47db-9c4e-6c51257abb4b None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:10.763972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c14ace-888e-47db-9c4e-6c51257abb4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:10.765457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c14ace-888e-47db-9c4e-6c51257abb4b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:10.772118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 503/1002] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:24:10 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:24:11.754332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57ec77-dfe9-4e88-bb18-a812435da863 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:11.754838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57ec77-dfe9-4e88-bb18-a812435da863 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:11.754838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57ec77-dfe9-4e88-bb18-a812435da863 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:11.756231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 500/1003] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:11.761429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712979ff-ccf4-43c6-a9ee-177e7ba9e0db None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:11.761820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712979ff-ccf4-43c6-a9ee-177e7ba9e0db None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:11.761986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712979ff-ccf4-43c6-a9ee-177e7ba9e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:11.779269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-712979ff-ccf4-43c6-a9ee-177e7ba9e0db None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:11.780463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-712979ff-ccf4-43c6-a9ee-177e7ba9e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:11.848173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 504/1004] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:11.870643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57ec77-dfe9-4e88-bb18-a812435da863 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:11.975100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57ec77-dfe9-4e88-bb18-a812435da863 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:12.008458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:12.009209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:12.009493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:12.009771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] PATH_INFO: `/v3/services/image` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:12.010420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:12.011785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:12.023386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:12.024380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:12.030873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 501/1005] 10.222.0.79 () {56 vars in 1105 bytes} [Fri May 27 09:24:11 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:12.033354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712979ff-ccf4-43c6-a9ee-177e7ba9e0db None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:12.058955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:12.137893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712979ff-ccf4-43c6-a9ee-177e7ba9e0db None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:12.171579 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c6ace-910a-45c9-a6c4-fb9994321089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:12.172237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c6ace-910a-45c9-a6c4-fb9994321089 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:12.172518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c6ace-910a-45c9-a6c4-fb9994321089 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:12.172790 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c6ace-910a-45c9-a6c4-fb9994321089 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:12.173510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c6ace-910a-45c9-a6c4-fb9994321089 None admin] RBAC: Adding query filter params (name=image) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:12.173813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c6ace-910a-45c9-a6c4-fb9994321089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:12.175174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c6ace-910a-45c9-a6c4-fb9994321089 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:12.184488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 505/1006] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:12.185654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:12.244506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:12.286000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab953bbd-d4c8-4faf-8a95-cd22c8af1e98 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:12.322513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a760b-b228-4d7b-a4f6-85557a9935e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:12.323176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a760b-b228-4d7b-a4f6-85557a9935e3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:12.323453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a760b-b228-4d7b-a4f6-85557a9935e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:12.323723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a760b-b228-4d7b-a4f6-85557a9935e3 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:12.324424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a760b-b228-4d7b-a4f6-85557a9935e3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:12.324728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a760b-b228-4d7b-a4f6-85557a9935e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:12.326144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a760b-b228-4d7b-a4f6-85557a9935e3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:12.337065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 502/1007] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:12.698351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa90cd-9f98-41e2-ba57-9957330f285e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:12.698730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa90cd-9f98-41e2-ba57-9957330f285e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:12.698929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa90cd-9f98-41e2-ba57-9957330f285e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:12.700355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 506/1008] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:12.705605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0ca5f-0741-4bc8-b60b-a8ce27305c7a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:12.705903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0ca5f-0741-4bc8-b60b-a8ce27305c7a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:12.706186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0ca5f-0741-4bc8-b60b-a8ce27305c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:12.723561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-67d0ca5f-0741-4bc8-b60b-a8ce27305c7a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:12.724747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-67d0ca5f-0741-4bc8-b60b-a8ce27305c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:12.796955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 503/1009] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:12.818016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa90cd-9f98-41e2-ba57-9957330f285e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:12.905839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:12.924954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa90cd-9f98-41e2-ba57-9957330f285e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:12.960390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607021a-9cfe-41db-afe5-c5b07114efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:12.961155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607021a-9cfe-41db-afe5-c5b07114efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:12.961441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607021a-9cfe-41db-afe5-c5b07114efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:12.961719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607021a-9cfe-41db-afe5-c5b07114efc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:12.963157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607021a-9cfe-41db-afe5-c5b07114efc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:12.964596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607021a-9cfe-41db-afe5-c5b07114efc2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:12.966467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 507/1010] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:12.972580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0ca5f-0741-4bc8-b60b-a8ce27305c7a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:12.975041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980229-fa21-4cba-90a9-2768542048b5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:12.975336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980229-fa21-4cba-90a9-2768542048b5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:12.975619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980229-fa21-4cba-90a9-2768542048b5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:12.977172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 508/1011] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:12.981989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5402dbd-642f-456f-acc5-fa44f593be95 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:12.982283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5402dbd-642f-456f-acc5-fa44f593be95 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:12.982569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5402dbd-642f-456f-acc5-fa44f593be95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:12.999362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a5402dbd-642f-456f-acc5-fa44f593be95 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:13.000563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a5402dbd-642f-456f-acc5-fa44f593be95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:13.030790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:13.071093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 509/1012] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:13.079673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0ca5f-0741-4bc8-b60b-a8ce27305c7a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:13.095200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5402dbd-642f-456f-acc5-fa44f593be95 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:13.117484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f4c2e-5ff2-4972-9aa1-1205d417a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:13.118156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4c2e-5ff2-4972-9aa1-1205d417a36c None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:13.118442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4c2e-5ff2-4972-9aa1-1205d417a36c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:13.118721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4c2e-5ff2-4972-9aa1-1205d417a36c None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:13.119438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f4c2e-5ff2-4972-9aa1-1205d417a36c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:13.120896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f4c2e-5ff2-4972-9aa1-1205d417a36c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:13.161228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 504/1013] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:24:12 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:13.186955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:13.207941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5402dbd-642f-456f-acc5-fa44f593be95 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:13.246246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:13.246976 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:13.247264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:13.247581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:13.248239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:13.249772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:13.262347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:13.264082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:13.270094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 510/1014] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:13.272522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f4c2e-5ff2-4972-9aa1-1205d417a36c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:13.382548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f4c2e-5ff2-4972-9aa1-1205d417a36c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:13.390565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:13.420083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:13.420773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:13.421087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:13.421369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:13.422096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:13.422405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:13.423825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:13.429685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 505/1015] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:24:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:13.436112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:13.537947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba00f4-3ca1-4d5e-9d6e-c088912e2042 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:13.573281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250426d-1498-48b1-8c98-6a5dfde624c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:13.573946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250426d-1498-48b1-8c98-6a5dfde624c6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:13.574227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250426d-1498-48b1-8c98-6a5dfde624c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:13.574503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250426d-1498-48b1-8c98-6a5dfde624c6 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:13.575206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250426d-1498-48b1-8c98-6a5dfde624c6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:13.576061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250426d-1498-48b1-8c98-6a5dfde624c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:13.577457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250426d-1498-48b1-8c98-6a5dfde624c6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:13.587468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 511/1016] 10.222.0.79 () {56 vars in 1112 bytes} [Fri May 27 09:24:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:13.588706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:13.690556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758723f9-3308-4ef6-a6b6-654205402b9a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:13.725724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a415a-1010-4894-9d4a-dabc50e50020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:13.726387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a415a-1010-4894-9d4a-dabc50e50020 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:13.726673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a415a-1010-4894-9d4a-dabc50e50020 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:13.726948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a415a-1010-4894-9d4a-dabc50e50020 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:13.727692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a415a-1010-4894-9d4a-dabc50e50020 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:13.729074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a415a-1010-4894-9d4a-dabc50e50020 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:13.748531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 506/1017] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:24:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:24:14.507486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91062f-8ac2-44e7-bfba-e6444a98a5ef None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:14.508036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91062f-8ac2-44e7-bfba-e6444a98a5ef None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:14.508036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91062f-8ac2-44e7-bfba-e6444a98a5ef None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:14.509569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 512/1018] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:14.514952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc2b32-7048-45f7-9b79-ae5d4b189840 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:14.515332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc2b32-7048-45f7-9b79-ae5d4b189840 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:14.515521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc2b32-7048-45f7-9b79-ae5d4b189840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:14.532674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-34fc2b32-7048-45f7-9b79-ae5d4b189840 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:14.533865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-34fc2b32-7048-45f7-9b79-ae5d4b189840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:14.554607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:14.609776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 507/1019] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:14.631486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91062f-8ac2-44e7-bfba-e6444a98a5ef None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:14.644624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:14.733911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91062f-8ac2-44e7-bfba-e6444a98a5ef None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:14.767104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e490d-aaa7-462f-a743-6e1360f23e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:14.767757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e490d-aaa7-462f-a743-6e1360f23e9d None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:14.768039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e490d-aaa7-462f-a743-6e1360f23e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:14.768312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e490d-aaa7-462f-a743-6e1360f23e9d None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:14.769056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e490d-aaa7-462f-a743-6e1360f23e9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:14.770421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e490d-aaa7-462f-a743-6e1360f23e9d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:14.786079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 513/1020] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:24:14 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:15.411613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667368-6afd-42fd-bb32-275397ac167b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:15.411920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667368-6afd-42fd-bb32-275397ac167b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:15.412176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8667368-6afd-42fd-bb32-275397ac167b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:15.413625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 508/1021] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:15.418939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56917a-2921-4253-88a0-97379fd45764 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:15.419804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56917a-2921-4253-88a0-97379fd45764 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:15.420094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56917a-2921-4253-88a0-97379fd45764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:15.436717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3c56917a-2921-4253-88a0-97379fd45764 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:15.437940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3c56917a-2921-4253-88a0-97379fd45764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:15.501597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:15.514672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 514/1022] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:15.539384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8667368-6afd-42fd-bb32-275397ac167b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:15.643434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8667368-6afd-42fd-bb32-275397ac167b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:15.676782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a956cf-0bb4-4830-ac32-f91625637bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:15.677603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a956cf-0bb4-4830-ac32-f91625637bbf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:15.677887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a956cf-0bb4-4830-ac32-f91625637bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:15.678165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a956cf-0bb4-4830-ac32-f91625637bbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:15.679373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a956cf-0bb4-4830-ac32-f91625637bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:15.680817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a956cf-0bb4-4830-ac32-f91625637bbf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:15.682624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 509/1023] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:15.688322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56917a-2921-4253-88a0-97379fd45764 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:15.787184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56917a-2921-4253-88a0-97379fd45764 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:15.820067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e8f8-c02c-4c7e-9eb6-2d25d230bdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:15.820734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e8f8-c02c-4c7e-9eb6-2d25d230bdb8 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:15.821050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e8f8-c02c-4c7e-9eb6-2d25d230bdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:15.821329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e8f8-c02c-4c7e-9eb6-2d25d230bdb8 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:15.822040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e8f8-c02c-4c7e-9eb6-2d25d230bdb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:15.823479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e8f8-c02c-4c7e-9eb6-2d25d230bdb8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:15.845647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 515/1024] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:24:15 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:16.046495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400018f-7d0a-4b67-a3b8-f2b904d213dd None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:16.046677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400018f-7d0a-4b67-a3b8-f2b904d213dd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:16.046959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400018f-7d0a-4b67-a3b8-f2b904d213dd None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:16.048377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 510/1025] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:16.054636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321028fe-5223-4916-b544-add36608fbb1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:16.054942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321028fe-5223-4916-b544-add36608fbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:16.055219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321028fe-5223-4916-b544-add36608fbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:16.072527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-321028fe-5223-4916-b544-add36608fbb1 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:16.073761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-321028fe-5223-4916-b544-add36608fbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:16.124421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:16.146302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 516/1026] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:16.169906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400018f-7d0a-4b67-a3b8-f2b904d213dd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:16.192551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:16.275974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400018f-7d0a-4b67-a3b8-f2b904d213dd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:16.314041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a608c-a238-4ba4-9998-96c4cd39f725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:16.314854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a608c-a238-4ba4-9998-96c4cd39f725 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:16.315130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a608c-a238-4ba4-9998-96c4cd39f725 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:16.315397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a608c-a238-4ba4-9998-96c4cd39f725 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:16.325615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a608c-a238-4ba4-9998-96c4cd39f725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-083a608c-a238-4ba4-9998-96c4cd39f725 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:16.333699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:16.334641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:16.336117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 511/1027] 10.222.0.79 () {56 vars in 1120 bytes} [Fri May 27 09:24:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:16.341018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321028fe-5223-4916-b544-add36608fbb1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:16.441061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321028fe-5223-4916-b544-add36608fbb1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:16.474707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:16.475375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:16.475654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:16.475931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:16.476666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:16.477003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:16.478357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:16.491484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 517/1028] 10.222.0.79 () {56 vars in 1115 bytes} [Fri May 27 09:24:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:16.493113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a608c-a238-4ba4-9998-96c4cd39f725 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:16.577668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:16.599099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a608c-a238-4ba4-9998-96c4cd39f725 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:16.633646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:16.634447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:16.634733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:16.635013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:16.646660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:16.648106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:16.665265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:16.666199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:16.667093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:16.667093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:16.667093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:16.667093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:16.667783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 512/1029] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:16.673140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:16.722929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:16.777871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe35fa-ca52-40cb-819e-7ca6c71178ee None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:16.811575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:16.812491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:16.812977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:16.813405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:16.814283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:16.814767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:16.816342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:16.834895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 518/1030] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:16.836649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:16.938097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae9903-2b17-42a6-9171-9a5a2f0d40a7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:16.967313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:16.973430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167c6d7-7849-4f90-99b9-7f63b98ad59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:16.974407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c6d7-7849-4f90-99b9-7f63b98ad59a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:16.974842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c6d7-7849-4f90-99b9-7f63b98ad59a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:16.975269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c6d7-7849-4f90-99b9-7f63b98ad59a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:16.983679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167c6d7-7849-4f90-99b9-7f63b98ad59a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:16.985365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167c6d7-7849-4f90-99b9-7f63b98ad59a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-4167c6d7-7849-4f90-99b9-7f63b98ad59a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:24:16.999486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:17.000645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:24:17.001858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:17.008899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 513/1031] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:24:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:17.010547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.015541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84340-20df-409b-b27b-6916bf014aac None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.015823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84340-20df-409b-b27b-6916bf014aac None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.016102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84340-20df-409b-b27b-6916bf014aac None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.017722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 514/1032] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:17.022858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31d93-95ab-4682-bc7a-a9cc85f036a5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.023144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31d93-95ab-4682-bc7a-a9cc85f036a5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.023422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31d93-95ab-4682-bc7a-a9cc85f036a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.040695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-18a31d93-95ab-4682-bc7a-a9cc85f036a5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:17.041916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-18a31d93-95ab-4682-bc7a-a9cc85f036a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:17.115309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 515/1033] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:17.123384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba869b18-b852-4faf-87cb-4b4a4001bf89 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.125725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:17.137323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a31d93-95ab-4682-bc7a-a9cc85f036a5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.162258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.162930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.163216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.163495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.164448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:17.164892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.166409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.186846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 519/1034] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:17.192629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.243407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a31d93-95ab-4682-bc7a-a9cc85f036a5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.268367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:17.282417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.283029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.283316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.283600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] PATH_INFO: `/v3/services/image` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.284253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.285654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:17.297901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:17.298927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:17.299786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 516/1035] 10.222.0.79 () {56 vars in 1105 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:17.304947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.307284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c473890-4f5f-44c3-8e36-100f5cc79866 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.342936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7636e-4e4b-4ff4-a100-eb0005251946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.343583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7636e-4e4b-4ff4-a100-eb0005251946 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.343864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7636e-4e4b-4ff4-a100-eb0005251946 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.344142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7636e-4e4b-4ff4-a100-eb0005251946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.374259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:17.410854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a8b4-f01a-43a4-8b77-750f4d34dc8a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.415502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7636e-4e4b-4ff4-a100-eb0005251946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.417007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7636e-4e4b-4ff4-a100-eb0005251946 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.446978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.447645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.447932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.448210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.448945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] RBAC: Adding query filter params (name=image) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:17.449257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.451169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.456686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 517/1036] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:17.462382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.515962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:17.528072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 520/1037] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:24:17.528957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7636e-4e4b-4ff4-a100-eb0005251946 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.569507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced133e6-ca85-47ae-ad10-1714606942ef None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.594173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:17.605430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.606103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.606413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.607351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.608063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] RBAC: Adding query filter params (type=image) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:17.608376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.609772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.614653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 518/1038] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:17.620258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.645240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7636e-4e4b-4ff4-a100-eb0005251946 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.682221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.683016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.683300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.683577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.695283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.696727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:17.717934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:17.718889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:17.719801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:17.719801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:17.719801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:17.719801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:17.719801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 521/1039] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:17.724566 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.726865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2b867-c5fb-4300-a2f7-9e707061f203 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.745123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:17.767420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.768084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.768376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.768653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.769485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] RBAC: Adding query filter params (interface=public, service_id=6dbc07a0b700479783aad1ee9772c736, region_id=RegionOne) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:17.769801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.771165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.776430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 519/1040] 10.222.0.79 () {56 vars in 1251 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/endpoints?service_id=6dbc07a0b700479783aad1ee9772c736&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:17.782481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.836562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e85f9a-5a9e-4bba-b466-eecb13d69940 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.851291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:17.872143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.873578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.874120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.874405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.875247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:17.875559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.876961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.888096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 522/1041] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:17.891076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dbb45-f179-41d4-8774-f05d667e1839 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:17.893584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.926880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8431a0-cb81-4704-be43-203bd07806ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:17.927466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8431a0-cb81-4704-be43-203bd07806ee None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.927745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8431a0-cb81-4704-be43-203bd07806ee None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.928069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8431a0-cb81-4704-be43-203bd07806ee None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.928755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8431a0-cb81-4704-be43-203bd07806ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:17.930243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8431a0-cb81-4704-be43-203bd07806ee None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:17.948893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 520/1042] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:24:18.016434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423f1b4-498c-4739-8faf-c641be063022 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.053239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f824eb-a83d-404c-b6b4-6b4313a6cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.054056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f824eb-a83d-404c-b6b4-6b4313a6cf38 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.054342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f824eb-a83d-404c-b6b4-6b4313a6cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.054623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f824eb-a83d-404c-b6b4-6b4313a6cf38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.062775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f824eb-a83d-404c-b6b4-6b4313a6cf38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:18.064273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f824eb-a83d-404c-b6b4-6b4313a6cf38 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c4f824eb-a83d-404c-b6b4-6b4313a6cf38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:24:18.079609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:18.080597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:18.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:24:18.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:24:18.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:24:18.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:24:18.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:24:18.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:24:18.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:18.081899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:18.082875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 523/1043] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:18.087939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8431a0-cb81-4704-be43-203bd07806ee None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:18.134343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:18.136906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39bd2f-d64c-4306-8101-08a3e4956a8b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.137201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39bd2f-d64c-4306-8101-08a3e4956a8b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.137486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39bd2f-d64c-4306-8101-08a3e4956a8b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.138960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 524/1044] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:18.143916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776c0b-1d1b-48ce-83ef-36cdde88fb9b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.144204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776c0b-1d1b-48ce-83ef-36cdde88fb9b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.144485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776c0b-1d1b-48ce-83ef-36cdde88fb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.162528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8c776c0b-1d1b-48ce-83ef-36cdde88fb9b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:18.163733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8c776c0b-1d1b-48ce-83ef-36cdde88fb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:18.193151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:18.197404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8431a0-cb81-4704-be43-203bd07806ee None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.236658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.240890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.240890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.241140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 525/1045] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:18.241224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.241224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:18.241224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:18.241224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:18.253090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 521/1046] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:18.259186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776c0b-1d1b-48ce-83ef-36cdde88fb9b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:18.260428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:18.369062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99cf22-2fcc-4be5-ac0f-0df778146091 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.370876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:18.377516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776c0b-1d1b-48ce-83ef-36cdde88fb9b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.408644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432c65-00b5-4c9e-b1af-41f9ed11a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.409464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432c65-00b5-4c9e-b1af-41f9ed11a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.409750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432c65-00b5-4c9e-b1af-41f9ed11a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.410052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432c65-00b5-4c9e-b1af-41f9ed11a6b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.411234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.411887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.412168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.412441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.413299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] RBAC: Adding query filter params (role.id=5425b2f010674b17b2c2b5c25f83c183, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=742917921213432a8ec7853ccf988fdf) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:18.413610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:18.415044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:18.421615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 526/1047] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:18 2022] GET /identity/v3/role_assignments?user.id=742917921213432a8ec7853ccf988fdf&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=5425b2f010674b17b2c2b5c25f83c183 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:18.425123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f432c65-00b5-4c9e-b1af-41f9ed11a6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1f432c65-00b5-4c9e-b1af-41f9ed11a6b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:18.433181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:18.434333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:18.435287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:18.436798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 522/1048] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:18.440699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:18.473629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:18.553241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e2118-d0cb-4d1c-9318-331d3937f3ca None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.589334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.590022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.590304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.590581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.591368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:18.591678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:18.593085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:18.607087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 527/1049] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:18.608708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432c65-00b5-4c9e-b1af-41f9ed11a6b3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:18.713426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432c65-00b5-4c9e-b1af-41f9ed11a6b3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.748106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ef06e-c889-43de-adea-61d6df4b3eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.748931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ef06e-c889-43de-adea-61d6df4b3eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.749215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ef06e-c889-43de-adea-61d6df4b3eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.749490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ef06e-c889-43de-adea-61d6df4b3eb6 None admin] PATH_INFO: `/v3/users/6e5e0129969b4dc0a05f0949256bd7bb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.763377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ef06e-c889-43de-adea-61d6df4b3eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=6e5e0129969b4dc0a05f0949256bd7bb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:18.764839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ef06e-c889-43de-adea-61d6df4b3eb6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:18.766744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 523/1050] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:18 2022] GET /identity/v3/users/6e5e0129969b4dc0a05f0949256bd7bb => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:18.772360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:18.863152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:18.874300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e98331-85f1-475f-8e40-4c9f02d13bdb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.909003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323459-cd31-47c4-8f2d-ff9f5d4b9b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.909662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323459-cd31-47c4-8f2d-ff9f5d4b9b99 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.909950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323459-cd31-47c4-8f2d-ff9f5d4b9b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.910231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b323459-cd31-47c4-8f2d-ff9f5d4b9b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.977285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b323459-cd31-47c4-8f2d-ff9f5d4b9b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:18.978741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b323459-cd31-47c4-8f2d-ff9f5d4b9b99 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:19.068308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:19.085000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 528/1051] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:24:19.086211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ef06e-c889-43de-adea-61d6df4b3eb6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:19.109542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:19.189876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ef06e-c889-43de-adea-61d6df4b3eb6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:19.223877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1756e-0d55-454b-a774-d69bcf6c73a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:19.224747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1756e-0d55-454b-a774-d69bcf6c73a4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:19.225048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1756e-0d55-454b-a774-d69bcf6c73a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:19.225328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1756e-0d55-454b-a774-d69bcf6c73a4 None admin] PATH_INFO: `/v3/projects/87851b4d1d2142edae78a98a1e82a878` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:19.226566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1756e-0d55-454b-a774-d69bcf6c73a4 None admin] RBAC: Authorizing `identity:get_project(project_id=87851b4d1d2142edae78a98a1e82a878)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:19.228515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1756e-0d55-454b-a774-d69bcf6c73a4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:19.230439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 524/1052] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:19 2022] GET /identity/v3/projects/87851b4d1d2142edae78a98a1e82a878 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:19.240843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323459-cd31-47c4-8f2d-ff9f5d4b9b99 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:19.346043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b323459-cd31-47c4-8f2d-ff9f5d4b9b99 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:19.379695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f568-5c75-4d0c-a50d-8ce06bac8213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:19.380349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f568-5c75-4d0c-a50d-8ce06bac8213 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:19.380635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f568-5c75-4d0c-a50d-8ce06bac8213 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:19.380934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f568-5c75-4d0c-a50d-8ce06bac8213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:19.381759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84f568-5c75-4d0c-a50d-8ce06bac8213 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=87851b4d1d2142edae78a98a1e82a878, user.id=6e5e0129969b4dc0a05f0949256bd7bb) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:19.382073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84f568-5c75-4d0c-a50d-8ce06bac8213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:19.383491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84f568-5c75-4d0c-a50d-8ce06bac8213 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:19.389687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 529/1053] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:19 2022] GET /identity/v3/role_assignments?user.id=6e5e0129969b4dc0a05f0949256bd7bb&scope.project.id=87851b4d1d2142edae78a98a1e82a878&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:20.163128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759488a-2371-4e2f-a17b-c4cc860effeb None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.163716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759488a-2371-4e2f-a17b-c4cc860effeb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.163716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759488a-2371-4e2f-a17b-c4cc860effeb None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.165115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 525/1054] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:20.170941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f5b8-f73e-47fb-a708-9e9c24660857 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.171360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f5b8-f73e-47fb-a708-9e9c24660857 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.171533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f5b8-f73e-47fb-a708-9e9c24660857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.188656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-20d0f5b8-f73e-47fb-a708-9e9c24660857 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:20.189878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-20d0f5b8-f73e-47fb-a708-9e9c24660857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:20.238348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:20.260978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 530/1055] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:20.279545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759488a-2371-4e2f-a17b-c4cc860effeb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:20.375950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:20.389758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759488a-2371-4e2f-a17b-c4cc860effeb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:20.422949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:20.423646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.423923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.424250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] PATH_INFO: `/v3/services/image` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.424936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:20.426318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:20.439288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:20.440387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:24:20.441674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:20.442848 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 526/1056] 10.222.0.79 () {56 vars in 1105 bytes} [Fri May 27 09:24:20 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:20.447148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0f5b8-f73e-47fb-a708-9e9c24660857 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:20.550327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0f5b8-f73e-47fb-a708-9e9c24660857 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:20.583857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5352e-5326-47ef-8f2c-e15230488092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:20.584893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5352e-5326-47ef-8f2c-e15230488092 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.585357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5352e-5326-47ef-8f2c-e15230488092 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.585834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5352e-5326-47ef-8f2c-e15230488092 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.586714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5352e-5326-47ef-8f2c-e15230488092 None admin] RBAC: Adding query filter params (name=image) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:20.587473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5352e-5326-47ef-8f2c-e15230488092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:20.589060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5352e-5326-47ef-8f2c-e15230488092 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:20.599266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 531/1057] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:20.600879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:20.632052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82f05-1171-4c9e-80ff-283c3798481d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.632341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82f05-1171-4c9e-80ff-283c3798481d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.632626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82f05-1171-4c9e-80ff-283c3798481d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.634031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 532/1058] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:20.638874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fd537-8584-4979-8f93-207905336814 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.639278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fd537-8584-4979-8f93-207905336814 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.639562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fd537-8584-4979-8f93-207905336814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.661067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0e2fd537-8584-4979-8f93-207905336814 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:20.662794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0e2fd537-8584-4979-8f93-207905336814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:20.708082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfed1-900a-4b8e-8e6f-23ce7d91722b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:20.718140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:20.742584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 533/1059] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:20.747563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:20.748230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.748511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.748786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.749515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:20.749821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:20.751176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:20.760742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 527/1060] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:20.761684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fd537-8584-4979-8f93-207905336814 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:20.764602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:20.785527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:20.865873 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fd537-8584-4979-8f93-207905336814 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:20.872372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad310d-dcad-42ae-866a-10e6ba65bdd1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:20.901623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94570cef-dc63-4bed-955b-eea643e5d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:20.902289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570cef-dc63-4bed-955b-eea643e5d9a3 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.902575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570cef-dc63-4bed-955b-eea643e5d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.902857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570cef-dc63-4bed-955b-eea643e5d9a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.904164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94570cef-dc63-4bed-955b-eea643e5d9a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:20.905582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94570cef-dc63-4bed-955b-eea643e5d9a3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:20.908394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d114c84-aafe-43df-874d-558651c8308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:20.909243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d114c84-aafe-43df-874d-558651c8308b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.909736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d114c84-aafe-43df-874d-558651c8308b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.909842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d114c84-aafe-43df-874d-558651c8308b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.920969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d114c84-aafe-43df-874d-558651c8308b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:20.933071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 534/1061] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:24:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-6d114c84-aafe-43df-874d-558651c8308b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:20.933290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:20.934187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:20.935105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 528/1062] 10.222.0.79 () {56 vars in 1120 bytes} [Fri May 27 09:24:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:20.937341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94570cef-dc63-4bed-955b-eea643e5d9a3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:20.976416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:21.057438 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94570cef-dc63-4bed-955b-eea643e5d9a3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:21.096105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae151-f893-487d-87a9-669d2819561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:21.096792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae151-f893-487d-87a9-669d2819561a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.097121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae151-f893-487d-87a9-669d2819561a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.097401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae151-f893-487d-87a9-669d2819561a None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.098183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ae151-f893-487d-87a9-669d2819561a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:21.098491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ae151-f893-487d-87a9-669d2819561a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:21.099900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ae151-f893-487d-87a9-669d2819561a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:21.113710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 535/1063] 10.222.0.79 () {56 vars in 1115 bytes} [Fri May 27 09:24:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:21.114893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d114c84-aafe-43df-874d-558651c8308b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:21.198345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:21.223722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d114c84-aafe-43df-874d-558651c8308b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:21.258122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:21.258847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.259131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.259407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.270842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:21.272279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:21.289241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:21.290179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:21.291122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:21.291122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:21.291122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:21.291122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:21.291122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 529/1064] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:21.296899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae151-f893-487d-87a9-669d2819561a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:21.390620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:21.401920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae151-f893-487d-87a9-669d2819561a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:21.438873 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7a6d7-84f9-41b2-acb1-2c0409b5f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:21.439548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7a6d7-84f9-41b2-acb1-2c0409b5f338 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.439837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7a6d7-84f9-41b2-acb1-2c0409b5f338 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.440120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7a6d7-84f9-41b2-acb1-2c0409b5f338 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.440884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7a6d7-84f9-41b2-acb1-2c0409b5f338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:21.441180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7a6d7-84f9-41b2-acb1-2c0409b5f338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:21.442555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7a6d7-84f9-41b2-acb1-2c0409b5f338 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:21.455279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 536/1065] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:21.460656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:21.564550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26fa69-f785-47ba-8ca0-f98fddb87a02 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:21.588816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8114f3-a5d2-4444-83e0-dc6b4e3f0af6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.589146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8114f3-a5d2-4444-83e0-dc6b4e3f0af6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.589430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8114f3-a5d2-4444-83e0-dc6b4e3f0af6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.591703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:21.592029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 537/1066] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:21.596028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892207db-81f0-4647-8af2-c94747df4ab1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.596324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892207db-81f0-4647-8af2-c94747df4ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.596615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892207db-81f0-4647-8af2-c94747df4ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.602632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:21.603426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.603712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.604138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.612484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:21.613962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:21.616173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-892207db-81f0-4647-8af2-c94747df4ab1 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:21.618065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-892207db-81f0-4647-8af2-c94747df4ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:24:21.628762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:21.629949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:24:21.631142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:21.635055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 530/1067] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:24:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:21.635889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:21.693170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 538/1068] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:21.715542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892207db-81f0-4647-8af2-c94747df4ab1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:21.742940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea2834-0189-4c35-8531-2a099ce01bc1 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:21.778366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:21.779042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.779334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.779603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.780444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:21.780757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:21.782213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:21.800351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 531/1069] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:24:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:21.805697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:21.807515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:21.827073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892207db-81f0-4647-8af2-c94747df4ab1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:21.857032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:21.862691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70710-fb73-4ea3-a1e1-985f91b1fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:21.863485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70710-fb73-4ea3-a1e1-985f91b1fc93 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.863771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70710-fb73-4ea3-a1e1-985f91b1fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.864050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70710-fb73-4ea3-a1e1-985f91b1fc93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.875118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70710-fb73-4ea3-a1e1-985f91b1fc93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ecb70710-fb73-4ea3-a1e1-985f91b1fc93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:21.882842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:21.883805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:21.884671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 539/1070] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:21.890016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70710-fb73-4ea3-a1e1-985f91b1fc93 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:21.913838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893d747-8fb6-49c6-8dcb-b71bde0456b0 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:21.951411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:21.952522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:21.953110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:21.953399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:21.965159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:21.967130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:21.985210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:21.986150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:21.987089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:21.987089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:21.987089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:21.987089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:21.987089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 532/1071] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:21.991821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:22.001786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70710-fb73-4ea3-a1e1-985f91b1fc93 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:22.037999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:22.038668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.038957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.039239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.039988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:22.040665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:22.041847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:22.056960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 540/1072] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:22.058884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:22.063464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:22.100129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:22.104488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2407b-cc3c-4330-adce-be6965d814cf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:22.141764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:22.142436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.142719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.142996 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.143722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:22.144027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:22.145455 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:22.158031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 533/1073] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:22.168893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:22.171215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faabed-f9ac-4965-82d6-30dae1abd5f8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:22.207299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf6899-d088-4b6b-8019-79d98715d905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:22.208172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf6899-d088-4b6b-8019-79d98715d905 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.208461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf6899-d088-4b6b-8019-79d98715d905 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.208751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf6899-d088-4b6b-8019-79d98715d905 None admin] PATH_INFO: `/v3/users/6e5e0129969b4dc0a05f0949256bd7bb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.209995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf6899-d088-4b6b-8019-79d98715d905 None admin] RBAC: Authorizing `identity:get_user(user_id=6e5e0129969b4dc0a05f0949256bd7bb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:22.211429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf6899-d088-4b6b-8019-79d98715d905 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:22.213679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 541/1074] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:22 2022] GET /identity/v3/users/6e5e0129969b4dc0a05f0949256bd7bb => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:22.219535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf6899-d088-4b6b-8019-79d98715d905 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:22.273834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3b4b4-1280-49a8-9a53-d918686270a8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:22.302953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:22.317439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:22.318238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.318524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.318805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.326484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:22.327866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:22.334666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf6899-d088-4b6b-8019-79d98715d905 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:24:22.343523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:22.344450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:22.345873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 534/1075] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:22.350368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:22.370220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:22.375761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9236ae-3c86-443f-8cfa-9c73c8f220fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:22.376615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9236ae-3c86-443f-8cfa-9c73c8f220fc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.377089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9236ae-3c86-443f-8cfa-9c73c8f220fc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.377374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9236ae-3c86-443f-8cfa-9c73c8f220fc None admin] PATH_INFO: `/v3/projects/87851b4d1d2142edae78a98a1e82a878` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.379151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9236ae-3c86-443f-8cfa-9c73c8f220fc None admin] RBAC: Authorizing `identity:get_project(project_id=87851b4d1d2142edae78a98a1e82a878)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:22.381121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9236ae-3c86-443f-8cfa-9c73c8f220fc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:22.383684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 542/1076] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:22 2022] GET /identity/v3/projects/87851b4d1d2142edae78a98a1e82a878 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:22.389493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9236ae-3c86-443f-8cfa-9c73c8f220fc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:22.455283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039824b3-5a2c-4e91-82f1-bbcfb46ff87a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:22.490023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:22.490681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.490965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.491244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.492032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:22.492345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:22.493795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:22.496218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9236ae-3c86-443f-8cfa-9c73c8f220fc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:22.506409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 535/1077] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:22.512216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:22.533088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debe31f-f262-4400-a93f-02d47a499921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:22.533975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe31f-f262-4400-a93f-02d47a499921 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.534286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe31f-f262-4400-a93f-02d47a499921 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.534651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debe31f-f262-4400-a93f-02d47a499921 None admin] PATH_INFO: `/v3/projects/87851b4d1d2142edae78a98a1e82a878/users/6e5e0129969b4dc0a05f0949256bd7bb/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.536644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debe31f-f262-4400-a93f-02d47a499921 None admin] RBAC: Authorizing `identity:create_grant(project_id=87851b4d1d2142edae78a98a1e82a878, user_id=6e5e0129969b4dc0a05f0949256bd7bb, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:22.538604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debe31f-f262-4400-a93f-02d47a499921 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:22.548420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:22.563061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 543/1078] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:24:22 2022] PUT /identity/v3/projects/87851b4d1d2142edae78a98a1e82a878/users/6e5e0129969b4dc0a05f0949256bd7bb/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:24:22.598645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:22.624157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e54ec-282a-4d2c-873c-8baf1b38b5bb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:22.660011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9eaab1-92a2-4edf-96e2-e25f14fc533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:22.660947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaab1-92a2-4edf-96e2-e25f14fc533b None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.661232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaab1-92a2-4edf-96e2-e25f14fc533b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.661512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaab1-92a2-4edf-96e2-e25f14fc533b None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/742917921213432a8ec7853ccf988fdf/roles/5425b2f010674b17b2c2b5c25f83c183` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.663774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9eaab1-92a2-4edf-96e2-e25f14fc533b None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=742917921213432a8ec7853ccf988fdf, role_id=5425b2f010674b17b2c2b5c25f83c183)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:22.665270 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9eaab1-92a2-4edf-96e2-e25f14fc533b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:22.682284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 536/1079] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:24:22 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/742917921213432a8ec7853ccf988fdf/roles/5425b2f010674b17b2c2b5c25f83c183 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:23.179354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d14a0-580d-48eb-981f-007a2ac71c79 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.179683 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d14a0-580d-48eb-981f-007a2ac71c79 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.179917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d14a0-580d-48eb-981f-007a2ac71c79 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.181498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 544/1080] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:23.186454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740671c4-0498-4726-9173-75ddfc37d8cd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.186748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740671c4-0498-4726-9173-75ddfc37d8cd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.187031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740671c4-0498-4726-9173-75ddfc37d8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.204066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-740671c4-0498-4726-9173-75ddfc37d8cd None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:23.205262 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-740671c4-0498-4726-9173-75ddfc37d8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:23.271253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 537/1081] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:23.295658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d14a0-580d-48eb-981f-007a2ac71c79 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.401133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d14a0-580d-48eb-981f-007a2ac71c79 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.434954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44419cf-c98c-499f-90a5-36c1865261dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.435557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44419cf-c98c-499f-90a5-36c1865261dd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.435840 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44419cf-c98c-499f-90a5-36c1865261dd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.436115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44419cf-c98c-499f-90a5-36c1865261dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.500196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.503447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44419cf-c98c-499f-90a5-36c1865261dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.505448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44419cf-c98c-499f-90a5-36c1865261dd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.607699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 545/1082] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:24:23.609059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740671c4-0498-4726-9173-75ddfc37d8cd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.677739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.715527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740671c4-0498-4726-9173-75ddfc37d8cd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.749074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b9097-15b4-45d5-9939-73e33ea43e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.749879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b9097-15b4-45d5-9939-73e33ea43e5f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.750160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b9097-15b4-45d5-9939-73e33ea43e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.750432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b9097-15b4-45d5-9939-73e33ea43e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.760584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b9097-15b4-45d5-9939-73e33ea43e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.762078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b9097-15b4-45d5-9939-73e33ea43e5f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a19b9097-15b4-45d5-9939-73e33ea43e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:23.781400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:23.782414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:23.783330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:23.783330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:23.783330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:23.783330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:23.785175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 538/1083] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:23.788673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44419cf-c98c-499f-90a5-36c1865261dd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.895617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.899124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44419cf-c98c-499f-90a5-36c1865261dd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.932950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c12a8-2c52-4049-82f5-dd6c5b1c0949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.933609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c12a8-2c52-4049-82f5-dd6c5b1c0949 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.933889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c12a8-2c52-4049-82f5-dd6c5b1c0949 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.934163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c12a8-2c52-4049-82f5-dd6c5b1c0949 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.935443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c12a8-2c52-4049-82f5-dd6c5b1c0949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:23.935743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c12a8-2c52-4049-82f5-dd6c5b1c0949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.937131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c12a8-2c52-4049-82f5-dd6c5b1c0949 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.956859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 546/1084] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:24.782897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e446e-301e-4a16-8078-731e8e6811d5 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:24.783400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e446e-301e-4a16-8078-731e8e6811d5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:24.783400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e446e-301e-4a16-8078-731e8e6811d5 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:24.784741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 539/1085] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:24.790011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38e4d9-bffd-4e9a-a252-7df6fd42c84b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:24.790430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38e4d9-bffd-4e9a-a252-7df6fd42c84b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:24.790570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38e4d9-bffd-4e9a-a252-7df6fd42c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:24.807493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ac38e4d9-bffd-4e9a-a252-7df6fd42c84b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:24.808692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ac38e4d9-bffd-4e9a-a252-7df6fd42c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:24.858952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86873fc-2e18-46b3-a5ec-7f8eacc20a5a None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:24.859240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86873fc-2e18-46b3-a5ec-7f8eacc20a5a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:24.859528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86873fc-2e18-46b3-a5ec-7f8eacc20a5a None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:24.860920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 540/1086] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:24.865935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfc69-e737-46b6-af9b-2b7211b06777 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:24.866216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfc69-e737-46b6-af9b-2b7211b06777 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:24.866493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfc69-e737-46b6-af9b-2b7211b06777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:24.876500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 547/1087] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:24.883823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3f4dfc69-e737-46b6-af9b-2b7211b06777 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:24.885046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3f4dfc69-e737-46b6-af9b-2b7211b06777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:24.900051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38e4d9-bffd-4e9a-a252-7df6fd42c84b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:24.950492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 541/1088] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:24.973908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfc69-e737-46b6-af9b-2b7211b06777 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:24.989115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:24.998840 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38e4d9-bffd-4e9a-a252-7df6fd42c84b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.022591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.032419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846e7e0-3409-4d10-b0dc-5ea5c689f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.033292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e7e0-3409-4d10-b0dc-5ea5c689f602 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.033526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e7e0-3409-4d10-b0dc-5ea5c689f602 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.033803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846e7e0-3409-4d10-b0dc-5ea5c689f602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.043702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846e7e0-3409-4d10-b0dc-5ea5c689f602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e846e7e0-3409-4d10-b0dc-5ea5c689f602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:25.051916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:25.053068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:25.053962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 548/1089] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:25.059207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846e7e0-3409-4d10-b0dc-5ea5c689f602 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.072677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfc69-e737-46b6-af9b-2b7211b06777 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.108464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc1a7-ee32-460a-87b9-05f19001ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.109321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc1a7-ee32-460a-87b9-05f19001ca3e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.109605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc1a7-ee32-460a-87b9-05f19001ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.109884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc1a7-ee32-460a-87b9-05f19001ca3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.119721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bc1a7-ee32-460a-87b9-05f19001ca3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-a85bc1a7-ee32-460a-87b9-05f19001ca3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:25.127819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:25.128802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:25.129713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 542/1090] 10.222.0.79 () {56 vars in 1120 bytes} [Fri May 27 09:24:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:25.134811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc1a7-ee32-460a-87b9-05f19001ca3e None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.157726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846e7e0-3409-4d10-b0dc-5ea5c689f602 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.190793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.191457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.191747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.192030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.192770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:25.193112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.194490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.202319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 549/1091] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:25.207875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.222948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.233509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc1a7-ee32-460a-87b9-05f19001ca3e None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.243467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.266466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.267135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.267416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.267695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.268434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:25.268740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.270124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.277924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 543/1092] 10.222.0.79 () {56 vars in 1115 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:25.284184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.313245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b0e85-0f17-4520-8f04-484fd0e42c15 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.347257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22483eb4-0eaf-4f7f-8344-576397443b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.348118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22483eb4-0eaf-4f7f-8344-576397443b18 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.348399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22483eb4-0eaf-4f7f-8344-576397443b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.348674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22483eb4-0eaf-4f7f-8344-576397443b18 None admin] PATH_INFO: `/v3/users/6e5e0129969b4dc0a05f0949256bd7bb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.349890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22483eb4-0eaf-4f7f-8344-576397443b18 None admin] RBAC: Authorizing `identity:get_user(user_id=6e5e0129969b4dc0a05f0949256bd7bb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.351322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22483eb4-0eaf-4f7f-8344-576397443b18 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.352973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 550/1093] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/users/6e5e0129969b4dc0a05f0949256bd7bb => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:25.359044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22483eb4-0eaf-4f7f-8344-576397443b18 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.387053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690e4b-0005-4e74-96b6-a4fbc7e897cd None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.420019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.420808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.421119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.421397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.431661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.433125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.439482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:25.450230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:25.451242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:25.452165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:25.452165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:25.452165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:25.452165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:25.452165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 544/1094] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:25.457056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.458563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22483eb4-0eaf-4f7f-8344-576397443b18 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.482768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.492911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f8342-160a-4e90-9fc5-ac821347b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.493570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f8342-160a-4e90-9fc5-ac821347b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.493851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f8342-160a-4e90-9fc5-ac821347b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.494122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f8342-160a-4e90-9fc5-ac821347b4b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.555161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003ece-9801-494b-a3be-776753b6d1ff None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.559028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f8342-160a-4e90-9fc5-ac821347b4b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.561058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f8342-160a-4e90-9fc5-ac821347b4b6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.590319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.591010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.591297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.591577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.592295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:25.592610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.593992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.605468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 545/1095] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:25.611475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.641386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.661005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 551/1096] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:24:25.666744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f8342-160a-4e90-9fc5-ac821347b4b6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.695056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.711046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c2755-dceb-444e-a9a8-dc5172585e47 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.745053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.745839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.746122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.746403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.753400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.754834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.763057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f8342-160a-4e90-9fc5-ac821347b4b6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:24:25.769798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:25.770998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:25.772243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 546/1097] 10.222.0.79 () {56 vars in 1093 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:25.776551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.800316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319ab4-2c2f-4b3b-b7a8-f0c66fed2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.801212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319ab4-2c2f-4b3b-b7a8-f0c66fed2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.801495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319ab4-2c2f-4b3b-b7a8-f0c66fed2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.801773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319ab4-2c2f-4b3b-b7a8-f0c66fed2ee6 None admin] PATH_INFO: `/v3/projects/87851b4d1d2142edae78a98a1e82a878` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.802952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1319ab4-2c2f-4b3b-b7a8-f0c66fed2ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=87851b4d1d2142edae78a98a1e82a878)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.804393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1319ab4-2c2f-4b3b-b7a8-f0c66fed2ee6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.806174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 552/1098] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/projects/87851b4d1d2142edae78a98a1e82a878 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:25.812062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319ab4-2c2f-4b3b-b7a8-f0c66fed2ee6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.860526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.874136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38032-c865-4197-b0bd-556e412767b3 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.907556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d734df-cb84-4698-b618-078378dee02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.908217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d734df-cb84-4698-b618-078378dee02b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.908495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d734df-cb84-4698-b618-078378dee02b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.908777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d734df-cb84-4698-b618-078378dee02b None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.909646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d734df-cb84-4698-b618-078378dee02b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:25.909954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d734df-cb84-4698-b618-078378dee02b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.911366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d734df-cb84-4698-b618-078378dee02b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.911470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319ab4-2c2f-4b3b-b7a8-f0c66fed2ee6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:25.928362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 547/1099] 10.222.0.79 () {56 vars in 1133 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:25.933918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d734df-cb84-4698-b618-078378dee02b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:25.936560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:25.946847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:25.947498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:25.947782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:25.948056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:25.948905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=87851b4d1d2142edae78a98a1e82a878, user.id=6e5e0129969b4dc0a05f0949256bd7bb) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:25.949219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:25.950659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:25.969632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 553/1100] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/role_assignments?user.id=6e5e0129969b4dc0a05f0949256bd7bb&scope.project.id=87851b4d1d2142edae78a98a1e82a878&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:26.036498 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d734df-cb84-4698-b618-078378dee02b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:26.071852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b411adf-3db9-4037-9ab1-06194bf3c67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:26.072423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b411adf-3db9-4037-9ab1-06194bf3c67c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.072717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b411adf-3db9-4037-9ab1-06194bf3c67c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.073006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b411adf-3db9-4037-9ab1-06194bf3c67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.144064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b411adf-3db9-4037-9ab1-06194bf3c67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:26.145566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b411adf-3db9-4037-9ab1-06194bf3c67c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:26.147490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:26.243800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 548/1101] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:24:26.249670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:26.350871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacc876-8c5d-4d3f-ad22-bb845a4f8b6f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:26.363562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:26.384652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:26.385459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.385743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.386019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.396112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:26.397562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:26.414262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:26.415332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:26.416441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:26.416441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:26.416441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:26.416441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:26.416981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 554/1102] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:26.421605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b411adf-3db9-4037-9ab1-06194bf3c67c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:26.517246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b411adf-3db9-4037-9ab1-06194bf3c67c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:26.518777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:26.552957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:26.553621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.553906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.554185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.554905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:26.555216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:26.556581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:26.567542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 549/1103] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:26.573049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:26.670697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4f713-1c96-4f76-ae1e-2c862a0b0fb0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:26.702761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:26.703541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.703822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.704099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.710639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:26.712352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:24:26.727424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:26.728511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:26.729680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:24:26.729680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:24:26.729680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:24:26.729680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:24:26.729680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:24:26.729680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:24:26.729680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:24:26.729680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:26.733124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 555/1104] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:26.734952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:26.832488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd30c51-66a8-4e55-866e-b621fa736c8b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:26.865087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a2b8c-2dcd-40d7-88c5-cd872caaf13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:26.865738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2b8c-2dcd-40d7-88c5-cd872caaf13c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.866019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2b8c-2dcd-40d7-88c5-cd872caaf13c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.866295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2b8c-2dcd-40d7-88c5-cd872caaf13c None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.867074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a2b8c-2dcd-40d7-88c5-cd872caaf13c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:26.867382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a2b8c-2dcd-40d7-88c5-cd872caaf13c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:26.868800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a2b8c-2dcd-40d7-88c5-cd872caaf13c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:26.880599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 550/1105] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:26.886648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:26.911807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:26.983678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b2f10-54ec-4878-8b21-ee492cb10249 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:27.016429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403b02c-44a5-4e70-a1bf-d65d1c8cc7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:27.017091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403b02c-44a5-4e70-a1bf-d65d1c8cc7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.017373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403b02c-44a5-4e70-a1bf-d65d1c8cc7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.017647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403b02c-44a5-4e70-a1bf-d65d1c8cc7c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.018460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403b02c-44a5-4e70-a1bf-d65d1c8cc7c9 None admin] RBAC: Adding query filter params (role.id=5425b2f010674b17b2c2b5c25f83c183, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=742917921213432a8ec7853ccf988fdf) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:27.018764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403b02c-44a5-4e70-a1bf-d65d1c8cc7c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:27.020179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403b02c-44a5-4e70-a1bf-d65d1c8cc7c9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:27.025924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 556/1106] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:26 2022] GET /identity/v3/role_assignments?user.id=742917921213432a8ec7853ccf988fdf&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=5425b2f010674b17b2c2b5c25f83c183 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:28.194113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fa1e-cdba-4282-973b-00845005fefb None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.194643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fa1e-cdba-4282-973b-00845005fefb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.194643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fa1e-cdba-4282-973b-00845005fefb None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.196034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 551/1107] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:28.201949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b037f-d259-4587-9aba-13a85c56b21a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.202349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b037f-d259-4587-9aba-13a85c56b21a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.202492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b037f-d259-4587-9aba-13a85c56b21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.218844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d34b037f-d259-4587-9aba-13a85c56b21a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:28.220004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d34b037f-d259-4587-9aba-13a85c56b21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:28.282871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 557/1108] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:28.307451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521fa1e-cdba-4282-973b-00845005fefb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:28.331471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:28.404563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521fa1e-cdba-4282-973b-00845005fefb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:28.437248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812e10a-a18a-403a-8e61-d3acaa78758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:28.438021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e10a-a18a-403a-8e61-d3acaa78758e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.438300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e10a-a18a-403a-8e61-d3acaa78758e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.438577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e10a-a18a-403a-8e61-d3acaa78758e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.439736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812e10a-a18a-403a-8e61-d3acaa78758e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:28.441180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812e10a-a18a-403a-8e61-d3acaa78758e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:28.442772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 552/1109] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:28.448427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b037f-d259-4587-9aba-13a85c56b21a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:28.466152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:28.544394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b037f-d259-4587-9aba-13a85c56b21a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:28.576947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b94e73-ab49-4552-8e07-58a6662d06d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:28.577614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b94e73-ab49-4552-8e07-58a6662d06d2 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.577901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b94e73-ab49-4552-8e07-58a6662d06d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.578179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b94e73-ab49-4552-8e07-58a6662d06d2 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.578881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b94e73-ab49-4552-8e07-58a6662d06d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:28.580308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b94e73-ab49-4552-8e07-58a6662d06d2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:28.598979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 558/1110] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:24:28 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:30.831287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67d24-4726-407e-b625-c7bd64086ea6 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:30.831799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67d24-4726-407e-b625-c7bd64086ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:30.831917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67d24-4726-407e-b625-c7bd64086ea6 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:30.833256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 553/1111] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:30.838772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ee16-c688-4ca6-bca1-83ab000d0b7d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:30.839204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ee16-c688-4ca6-bca1-83ab000d0b7d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:30.839334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ee16-c688-4ca6-bca1-83ab000d0b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:30.855680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-99c8ee16-c688-4ca6-bca1-83ab000d0b7d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:30.857398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-99c8ee16-c688-4ca6-bca1-83ab000d0b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:30.921700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 559/1112] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:30.945201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b67d24-4726-407e-b625-c7bd64086ea6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.032588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.042771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b67d24-4726-407e-b625-c7bd64086ea6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.075155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c5a76-8202-4be8-94c7-dda113f5b208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.075991 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5a76-8202-4be8-94c7-dda113f5b208 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.076277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5a76-8202-4be8-94c7-dda113f5b208 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.076555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5a76-8202-4be8-94c7-dda113f5b208 None admin] PATH_INFO: `/v3/roles/5a932a8a65dd4faab8c58bcf29388fc7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.078052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c5a76-8202-4be8-94c7-dda113f5b208 None admin] RBAC: Authorizing `identity:get_role(role_id=5a932a8a65dd4faab8c58bcf29388fc7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.079416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c5a76-8202-4be8-94c7-dda113f5b208 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.080770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 554/1113] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:30 2022] GET /identity/v3/roles/5a932a8a65dd4faab8c58bcf29388fc7 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:31.086464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8ee16-c688-4ca6-bca1-83ab000d0b7d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.089705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.184040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8ee16-c688-4ca6-bca1-83ab000d0b7d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.216448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913dea0-f33a-4ae3-ba3f-4d4ab634491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.217328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913dea0-f33a-4ae3-ba3f-4d4ab634491c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.217611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913dea0-f33a-4ae3-ba3f-4d4ab634491c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.217889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913dea0-f33a-4ae3-ba3f-4d4ab634491c None admin] PATH_INFO: `/v3/users/04a88e98f0d141939e15b222c7e93570` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.230941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913dea0-f33a-4ae3-ba3f-4d4ab634491c None admin] RBAC: Authorizing `identity:get_user(user_id=04a88e98f0d141939e15b222c7e93570)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.232986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913dea0-f33a-4ae3-ba3f-4d4ab634491c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.234599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 560/1114] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:31 2022] GET /identity/v3/users/04a88e98f0d141939e15b222c7e93570 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:31.240126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c5a76-8202-4be8-94c7-dda113f5b208 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.336027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c5a76-8202-4be8-94c7-dda113f5b208 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.368903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20b219-e46c-4e41-b7b1-7ded27d38f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.369487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20b219-e46c-4e41-b7b1-7ded27d38f16 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.369764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20b219-e46c-4e41-b7b1-7ded27d38f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.370035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20b219-e46c-4e41-b7b1-7ded27d38f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.396037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.438610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20b219-e46c-4e41-b7b1-7ded27d38f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.440034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20b219-e46c-4e41-b7b1-7ded27d38f16 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.532785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 555/1115] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:24:31.538667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913dea0-f33a-4ae3-ba3f-4d4ab634491c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.598621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.635921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913dea0-f33a-4ae3-ba3f-4d4ab634491c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.669161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0f66-854a-4960-a6b1-be213079e00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.670004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0f66-854a-4960-a6b1-be213079e00b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.670289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0f66-854a-4960-a6b1-be213079e00b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.670568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0f66-854a-4960-a6b1-be213079e00b None admin] PATH_INFO: `/v3/projects/87851b4d1d2142edae78a98a1e82a878` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.671742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0f66-854a-4960-a6b1-be213079e00b None admin] RBAC: Authorizing `identity:get_project(project_id=87851b4d1d2142edae78a98a1e82a878)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.673186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0f66-854a-4960-a6b1-be213079e00b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.674861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 561/1116] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:31 2022] GET /identity/v3/projects/87851b4d1d2142edae78a98a1e82a878 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:31.680728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20b219-e46c-4e41-b7b1-7ded27d38f16 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.737639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.780244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20b219-e46c-4e41-b7b1-7ded27d38f16 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.815083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26413cb1-6fc0-4ae2-91b8-780bf3e68b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.815737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26413cb1-6fc0-4ae2-91b8-780bf3e68b0e None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.816018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26413cb1-6fc0-4ae2-91b8-780bf3e68b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.816293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26413cb1-6fc0-4ae2-91b8-780bf3e68b0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.817147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26413cb1-6fc0-4ae2-91b8-780bf3e68b0e None admin] RBAC: Adding query filter params (role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=87851b4d1d2142edae78a98a1e82a878, user.id=04a88e98f0d141939e15b222c7e93570) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:31.817460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26413cb1-6fc0-4ae2-91b8-780bf3e68b0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.818880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26413cb1-6fc0-4ae2-91b8-780bf3e68b0e None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.824501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 556/1117] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:31 2022] GET /identity/v3/role_assignments?user.id=04a88e98f0d141939e15b222c7e93570&scope.project.id=87851b4d1d2142edae78a98a1e82a878&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:33.990448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777cfd3-1f82-40b0-a1e9-e0c3642637f7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:33.991009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777cfd3-1f82-40b0-a1e9-e0c3642637f7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:33.991009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777cfd3-1f82-40b0-a1e9-e0c3642637f7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:33.992341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 562/1118] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:33.997497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ea106-834c-4347-b7ff-7181852cfd75 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:33.997919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ea106-834c-4347-b7ff-7181852cfd75 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:33.998056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ea106-834c-4347-b7ff-7181852cfd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:34.014346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-646ea106-834c-4347-b7ff-7181852cfd75 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:34.015532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-646ea106-834c-4347-b7ff-7181852cfd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:34.078269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 557/1119] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:34.100704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777cfd3-1f82-40b0-a1e9-e0c3642637f7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:34.195897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777cfd3-1f82-40b0-a1e9-e0c3642637f7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:34.223059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:34.229097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6891-2847-4ff7-a13a-d5ee8d9801b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:34.229926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6891-2847-4ff7-a13a-d5ee8d9801b8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:34.230201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6891-2847-4ff7-a13a-d5ee8d9801b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:34.230472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6891-2847-4ff7-a13a-d5ee8d9801b8 None admin] PATH_INFO: `/v3/roles/5a932a8a65dd4faab8c58bcf29388fc7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:34.232454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b6891-2847-4ff7-a13a-d5ee8d9801b8 None admin] RBAC: Authorizing `identity:get_role(role_id=5a932a8a65dd4faab8c58bcf29388fc7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:34.233834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b6891-2847-4ff7-a13a-d5ee8d9801b8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:34.235168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 563/1120] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:34 2022] GET /identity/v3/roles/5a932a8a65dd4faab8c58bcf29388fc7 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:34.240969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ea106-834c-4347-b7ff-7181852cfd75 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:34.291587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:34.338021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ea106-834c-4347-b7ff-7181852cfd75 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:34.370426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf5d6-59d1-460e-89be-052a8ac904d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:34.371289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf5d6-59d1-460e-89be-052a8ac904d8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:34.371574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf5d6-59d1-460e-89be-052a8ac904d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:34.371855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf5d6-59d1-460e-89be-052a8ac904d8 None admin] PATH_INFO: `/v3/users/04a88e98f0d141939e15b222c7e93570` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:34.373053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cf5d6-59d1-460e-89be-052a8ac904d8 None admin] RBAC: Authorizing `identity:get_user(user_id=04a88e98f0d141939e15b222c7e93570)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:34.374486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cf5d6-59d1-460e-89be-052a8ac904d8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:34.376115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 558/1121] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:34 2022] GET /identity/v3/users/04a88e98f0d141939e15b222c7e93570 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:34.381820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6891-2847-4ff7-a13a-d5ee8d9801b8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:34.477164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6891-2847-4ff7-a13a-d5ee8d9801b8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:34.508383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde7edc-8ae0-4f39-86f7-695febdc32e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:34.509201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde7edc-8ae0-4f39-86f7-695febdc32e1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:34.509480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde7edc-8ae0-4f39-86f7-695febdc32e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:34.509756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde7edc-8ae0-4f39-86f7-695febdc32e1 None admin] PATH_INFO: `/v3/projects/87851b4d1d2142edae78a98a1e82a878` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:34.510908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde7edc-8ae0-4f39-86f7-695febdc32e1 None admin] RBAC: Authorizing `identity:get_project(project_id=87851b4d1d2142edae78a98a1e82a878)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:34.512847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde7edc-8ae0-4f39-86f7-695febdc32e1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:34.514492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 564/1122] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:34 2022] GET /identity/v3/projects/87851b4d1d2142edae78a98a1e82a878 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:34.520187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf5d6-59d1-460e-89be-052a8ac904d8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:34.619513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf5d6-59d1-460e-89be-052a8ac904d8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:34.641814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:34.656050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560e54-1757-4164-832e-816c6eb9bdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:34.656945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560e54-1757-4164-832e-816c6eb9bdf3 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:34.657228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560e54-1757-4164-832e-816c6eb9bdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:34.657501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560e54-1757-4164-832e-816c6eb9bdf3 None admin] PATH_INFO: `/v3/projects/87851b4d1d2142edae78a98a1e82a878/users/04a88e98f0d141939e15b222c7e93570/roles/5a932a8a65dd4faab8c58bcf29388fc7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:34.659673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b560e54-1757-4164-832e-816c6eb9bdf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=87851b4d1d2142edae78a98a1e82a878, user_id=04a88e98f0d141939e15b222c7e93570, role_id=5a932a8a65dd4faab8c58bcf29388fc7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:34.661125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b560e54-1757-4164-832e-816c6eb9bdf3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:34.673069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 559/1123] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:24:34 2022] PUT /identity/v3/projects/87851b4d1d2142edae78a98a1e82a878/users/04a88e98f0d141939e15b222c7e93570/roles/5a932a8a65dd4faab8c58bcf29388fc7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:36.829878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed6e7-d0b8-407b-bed6-9452106025ea None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:36.830396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed6e7-d0b8-407b-bed6-9452106025ea None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:36.830492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed6e7-d0b8-407b-bed6-9452106025ea None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:36.831805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 565/1124] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:36.837500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2989e-bc41-49cc-87b5-44093dd5815f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:36.837915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2989e-bc41-49cc-87b5-44093dd5815f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:36.838061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2989e-bc41-49cc-87b5-44093dd5815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:36.854971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-85f2989e-bc41-49cc-87b5-44093dd5815f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:36.856156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-85f2989e-bc41-49cc-87b5-44093dd5815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:36.920275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 560/1125] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:36.943882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fed6e7-d0b8-407b-bed6-9452106025ea None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:37.008139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:37.042520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fed6e7-d0b8-407b-bed6-9452106025ea None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:37.075365 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1f913-f728-4f30-bfa6-dbffab470170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:37.076201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1f913-f728-4f30-bfa6-dbffab470170 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.076485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1f913-f728-4f30-bfa6-dbffab470170 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.076762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1f913-f728-4f30-bfa6-dbffab470170 None admin] PATH_INFO: `/v3/roles/5a932a8a65dd4faab8c58bcf29388fc7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.078241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1f913-f728-4f30-bfa6-dbffab470170 None admin] RBAC: Authorizing `identity:get_role(role_id=5a932a8a65dd4faab8c58bcf29388fc7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:37.079602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1f913-f728-4f30-bfa6-dbffab470170 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:37.081044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 566/1126] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:36 2022] GET /identity/v3/roles/5a932a8a65dd4faab8c58bcf29388fc7 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:37.087009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2989e-bc41-49cc-87b5-44093dd5815f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:37.180099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2989e-bc41-49cc-87b5-44093dd5815f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:37.190919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:37.214711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1b0a-3c5b-4f1a-acd5-25cd438dd6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:37.215598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1b0a-3c5b-4f1a-acd5-25cd438dd6da None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.215881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1b0a-3c5b-4f1a-acd5-25cd438dd6da None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.216159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1b0a-3c5b-4f1a-acd5-25cd438dd6da None admin] PATH_INFO: `/v3/users/04a88e98f0d141939e15b222c7e93570` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.217357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1b0a-3c5b-4f1a-acd5-25cd438dd6da None admin] RBAC: Authorizing `identity:get_user(user_id=04a88e98f0d141939e15b222c7e93570)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:37.218791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1b0a-3c5b-4f1a-acd5-25cd438dd6da None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:37.220402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 561/1127] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:37 2022] GET /identity/v3/users/04a88e98f0d141939e15b222c7e93570 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:37.225935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1f913-f728-4f30-bfa6-dbffab470170 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:37.321758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1f913-f728-4f30-bfa6-dbffab470170 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:37.353735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df2796-2669-492b-b7ba-85dbf86dc6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:37.354309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2796-2669-492b-b7ba-85dbf86dc6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.354588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2796-2669-492b-b7ba-85dbf86dc6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.354862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2796-2669-492b-b7ba-85dbf86dc6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.357949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:37.419942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df2796-2669-492b-b7ba-85dbf86dc6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:37.421412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df2796-2669-492b-b7ba-85dbf86dc6e2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:37.514172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 567/1128] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:24:37.520040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1b0a-3c5b-4f1a-acd5-25cd438dd6da None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:37.616457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1b0a-3c5b-4f1a-acd5-25cd438dd6da None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:37.649924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179fbb0-daaf-4005-8ace-66d450051b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:37.650766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fbb0-daaf-4005-8ace-66d450051b52 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.651047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fbb0-daaf-4005-8ace-66d450051b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.651321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fbb0-daaf-4005-8ace-66d450051b52 None admin] PATH_INFO: `/v3/projects/87851b4d1d2142edae78a98a1e82a878` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.652493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179fbb0-daaf-4005-8ace-66d450051b52 None admin] RBAC: Authorizing `identity:get_project(project_id=87851b4d1d2142edae78a98a1e82a878)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:37.653989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179fbb0-daaf-4005-8ace-66d450051b52 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:37.655661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 562/1129] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:37 2022] GET /identity/v3/projects/87851b4d1d2142edae78a98a1e82a878 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:37.661519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df2796-2669-492b-b7ba-85dbf86dc6e2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:37.694364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:37.757527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df2796-2669-492b-b7ba-85dbf86dc6e2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:37.789819 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc92c7f-6c09-4abb-a294-158beb2f117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:37.790453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92c7f-6c09-4abb-a294-158beb2f117b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.790734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92c7f-6c09-4abb-a294-158beb2f117b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.791012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92c7f-6c09-4abb-a294-158beb2f117b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.791834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc92c7f-6c09-4abb-a294-158beb2f117b None admin] RBAC: Adding query filter params (role.id=5a932a8a65dd4faab8c58bcf29388fc7, scope.project.id=87851b4d1d2142edae78a98a1e82a878, user.id=04a88e98f0d141939e15b222c7e93570) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:37.792147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc92c7f-6c09-4abb-a294-158beb2f117b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:37.794134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc92c7f-6c09-4abb-a294-158beb2f117b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:37.799736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 568/1130] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:37 2022] GET /identity/v3/role_assignments?user.id=04a88e98f0d141939e15b222c7e93570&scope.project.id=87851b4d1d2142edae78a98a1e82a878&role.id=5a932a8a65dd4faab8c58bcf29388fc7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:39.996724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f41bc-57f2-4ec6-a128-a42bbfad13e5 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.997292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f41bc-57f2-4ec6-a128-a42bbfad13e5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.997292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f41bc-57f2-4ec6-a128-a42bbfad13e5 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.998689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 563/1131] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:40.003797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea50cd-4cab-4cb0-8c87-79670afb91bf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:40.004208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea50cd-4cab-4cb0-8c87-79670afb91bf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:40.004353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea50cd-4cab-4cb0-8c87-79670afb91bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:40.021169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4cea50cd-4cab-4cb0-8c87-79670afb91bf None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:40.022339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4cea50cd-4cab-4cb0-8c87-79670afb91bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:40.085032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 569/1132] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:40.109507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f41bc-57f2-4ec6-a128-a42bbfad13e5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:40.155336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:40.206535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f41bc-57f2-4ec6-a128-a42bbfad13e5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:40.239777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8e549-b3dd-4ab0-832f-555ef0ccda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:40.240554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e549-b3dd-4ab0-832f-555ef0ccda52 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:40.240862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e549-b3dd-4ab0-832f-555ef0ccda52 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:40.241143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e549-b3dd-4ab0-832f-555ef0ccda52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:40.242308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8e549-b3dd-4ab0-832f-555ef0ccda52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:40.243727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8e549-b3dd-4ab0-832f-555ef0ccda52 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:40.245363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 564/1133] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:40.251072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea50cd-4cab-4cb0-8c87-79670afb91bf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:40.277160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:40.347812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea50cd-4cab-4cb0-8c87-79670afb91bf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:40.379218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587653c5-9e03-4172-b54f-80ebd13ab9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:40.379869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587653c5-9e03-4172-b54f-80ebd13ab9ba None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:40.380151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587653c5-9e03-4172-b54f-80ebd13ab9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:40.380428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587653c5-9e03-4172-b54f-80ebd13ab9ba None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:40.381170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587653c5-9e03-4172-b54f-80ebd13ab9ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:40.382590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587653c5-9e03-4172-b54f-80ebd13ab9ba None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:40.407751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 570/1134] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:24:40 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:42.568664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edefb78-d3cf-4fc4-b8c9-ad4adfc58646 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.569216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edefb78-d3cf-4fc4-b8c9-ad4adfc58646 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.569216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edefb78-d3cf-4fc4-b8c9-ad4adfc58646 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.570512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 565/1135] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:42.575626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a7c75-48ee-4093-9d65-1beaaaf3a954 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.576050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a7c75-48ee-4093-9d65-1beaaaf3a954 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.576194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a7c75-48ee-4093-9d65-1beaaaf3a954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.592753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-523a7c75-48ee-4093-9d65-1beaaaf3a954 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:42.593958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-523a7c75-48ee-4093-9d65-1beaaaf3a954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:42.657285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 571/1136] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:42.681213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edefb78-d3cf-4fc4-b8c9-ad4adfc58646 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:42.777250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edefb78-d3cf-4fc4-b8c9-ad4adfc58646 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:42.790429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:42.810348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457d7a3-15ea-4a83-b7f9-1c32eccc71d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:42.811119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d7a3-15ea-4a83-b7f9-1c32eccc71d3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.811397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d7a3-15ea-4a83-b7f9-1c32eccc71d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.811671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d7a3-15ea-4a83-b7f9-1c32eccc71d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.812815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d7a3-15ea-4a83-b7f9-1c32eccc71d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:42.814247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d7a3-15ea-4a83-b7f9-1c32eccc71d3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:42.815822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 566/1137] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:42.821412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a7c75-48ee-4093-9d65-1beaaaf3a954 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:42.832493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:42.916681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a7c75-48ee-4093-9d65-1beaaaf3a954 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:42.950162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1426c25-1a25-43c4-9dec-79f67c6246bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:42.950818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1426c25-1a25-43c4-9dec-79f67c6246bc None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.951098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1426c25-1a25-43c4-9dec-79f67c6246bc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.951371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1426c25-1a25-43c4-9dec-79f67c6246bc None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.952068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1426c25-1a25-43c4-9dec-79f67c6246bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:42.953527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1426c25-1a25-43c4-9dec-79f67c6246bc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:42.972712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 572/1138] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:24:42 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:45.179367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b03f5-409e-4da5-9a9b-79c0f5ce1ace None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.179936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b03f5-409e-4da5-9a9b-79c0f5ce1ace None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.179936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b03f5-409e-4da5-9a9b-79c0f5ce1ace None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.181337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 567/1139] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:45.187138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a265b1-8b52-4af3-8b68-f556192d3b77 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.187593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a265b1-8b52-4af3-8b68-f556192d3b77 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.187734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a265b1-8b52-4af3-8b68-f556192d3b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.204584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e0a265b1-8b52-4af3-8b68-f556192d3b77 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:45.205804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e0a265b1-8b52-4af3-8b68-f556192d3b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:45.263813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.271859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 573/1140] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:45.295632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b03f5-409e-4da5-9a9b-79c0f5ce1ace None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.394233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b03f5-409e-4da5-9a9b-79c0f5ce1ace None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.425922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc308-4293-4fb2-89cf-d61b92c4b53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.426701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc308-4293-4fb2-89cf-d61b92c4b53c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.426984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc308-4293-4fb2-89cf-d61b92c4b53c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.427261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc308-4293-4fb2-89cf-d61b92c4b53c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.437507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fc308-4293-4fb2-89cf-d61b92c4b53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-af5fc308-4293-4fb2-89cf-d61b92c4b53c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:45.445034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:45.446113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:45.447162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 568/1141] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:45.452759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a265b1-8b52-4af3-8b68-f556192d3b77 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.545646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a265b1-8b52-4af3-8b68-f556192d3b77 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.577782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.578444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.578721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.578993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.579725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:45.580030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.581425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.589606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 574/1142] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:45.595334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc308-4293-4fb2-89cf-d61b92c4b53c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.640046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.695499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc308-4293-4fb2-89cf-d61b92c4b53c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.727220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8f152-89ed-432d-8566-d4d433ea2762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.728084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f152-89ed-432d-8566-d4d433ea2762 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.728362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f152-89ed-432d-8566-d4d433ea2762 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.728635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f152-89ed-432d-8566-d4d433ea2762 None admin] PATH_INFO: `/v3/users/c40c770ab9734d38b1eba58161ad6800` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.741833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8f152-89ed-432d-8566-d4d433ea2762 None admin] RBAC: Authorizing `identity:get_user(user_id=c40c770ab9734d38b1eba58161ad6800)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.743261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8f152-89ed-432d-8566-d4d433ea2762 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.744918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 569/1143] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:45 2022] GET /identity/v3/users/c40c770ab9734d38b1eba58161ad6800 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:45.751106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.806452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.846455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977791-a6a1-43ec-baf3-d4a17557f186 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.878632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16a8a5-ef20-4397-864d-864c5208e1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.879264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16a8a5-ef20-4397-864d-864c5208e1ad None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.879541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16a8a5-ef20-4397-864d-864c5208e1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.879813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16a8a5-ef20-4397-864d-864c5208e1ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.943395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16a8a5-ef20-4397-864d-864c5208e1ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.944816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16a8a5-ef20-4397-864d-864c5208e1ad None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.998131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:46.038026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 575/1144] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:24:46.043770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8f152-89ed-432d-8566-d4d433ea2762 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:46.137948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:46.140820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8f152-89ed-432d-8566-d4d433ea2762 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:46.173207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76aa70-38e3-4db2-b9cc-9b4a16eeeb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:46.174040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76aa70-38e3-4db2-b9cc-9b4a16eeeb3d None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:46.174317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76aa70-38e3-4db2-b9cc-9b4a16eeeb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:46.174589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76aa70-38e3-4db2-b9cc-9b4a16eeeb3d None admin] PATH_INFO: `/v3/projects/b82bfc145af94a8ea65c00ef1ebec75f` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:46.175738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76aa70-38e3-4db2-b9cc-9b4a16eeeb3d None admin] RBAC: Authorizing `identity:get_project(project_id=b82bfc145af94a8ea65c00ef1ebec75f)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:46.177256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76aa70-38e3-4db2-b9cc-9b4a16eeeb3d None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:46.178920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 570/1145] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:46 2022] GET /identity/v3/projects/b82bfc145af94a8ea65c00ef1ebec75f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:46.185289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16a8a5-ef20-4397-864d-864c5208e1ad None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:46.278522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16a8a5-ef20-4397-864d-864c5208e1ad None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:46.311472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413080b5-bb14-4f2a-8f69-6b621fad48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:46.312114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413080b5-bb14-4f2a-8f69-6b621fad48ae None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:46.312393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413080b5-bb14-4f2a-8f69-6b621fad48ae None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:46.312665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413080b5-bb14-4f2a-8f69-6b621fad48ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:46.313508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413080b5-bb14-4f2a-8f69-6b621fad48ae None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=b82bfc145af94a8ea65c00ef1ebec75f, user.id=c40c770ab9734d38b1eba58161ad6800) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:46.313816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413080b5-bb14-4f2a-8f69-6b621fad48ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:46.315235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413080b5-bb14-4f2a-8f69-6b621fad48ae None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:46.320551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 576/1146] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:46 2022] GET /identity/v3/role_assignments?user.id=c40c770ab9734d38b1eba58161ad6800&scope.project.id=b82bfc145af94a8ea65c00ef1ebec75f&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:48.429838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30253523-b50a-4960-b8e8-f6b7247806d3 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:48.430329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30253523-b50a-4960-b8e8-f6b7247806d3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:48.430416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30253523-b50a-4960-b8e8-f6b7247806d3 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:48.431761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 571/1147] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:48.437358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0db1-612d-4380-9ae2-79c10a5a000d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:48.437783 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0db1-612d-4380-9ae2-79c10a5a000d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:48.437925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0db1-612d-4380-9ae2-79c10a5a000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:48.455564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b64b0db1-612d-4380-9ae2-79c10a5a000d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:48.456749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b64b0db1-612d-4380-9ae2-79c10a5a000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:48.472978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:48.522660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 577/1148] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:48.545240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30253523-b50a-4960-b8e8-f6b7247806d3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:48.641754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30253523-b50a-4960-b8e8-f6b7247806d3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:48.673610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b091b81-d04c-4bf1-92e7-0a7bb6f237e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:48.674378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b091b81-d04c-4bf1-92e7-0a7bb6f237e9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:48.674659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b091b81-d04c-4bf1-92e7-0a7bb6f237e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:48.674937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b091b81-d04c-4bf1-92e7-0a7bb6f237e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:48.685144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b091b81-d04c-4bf1-92e7-0a7bb6f237e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-1b091b81-d04c-4bf1-92e7-0a7bb6f237e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:48.692646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:48.693769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:48.694671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 572/1149] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:48.699563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b0db1-612d-4380-9ae2-79c10a5a000d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:48.793473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b0db1-612d-4380-9ae2-79c10a5a000d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:48.825409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:48.826054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:48.826332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:48.826605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:48.827333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:48.827634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:48.829020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:48.836937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 578/1150] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:48.842526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b091b81-d04c-4bf1-92e7-0a7bb6f237e9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:48.870299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:48.939558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b091b81-d04c-4bf1-92e7-0a7bb6f237e9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:48.971908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29dea-1f61-4242-851d-e0e7e05aa775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:48.972757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29dea-1f61-4242-851d-e0e7e05aa775 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:48.973063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29dea-1f61-4242-851d-e0e7e05aa775 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:48.973336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29dea-1f61-4242-851d-e0e7e05aa775 None admin] PATH_INFO: `/v3/users/c40c770ab9734d38b1eba58161ad6800` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:48.974512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29dea-1f61-4242-851d-e0e7e05aa775 None admin] RBAC: Authorizing `identity:get_user(user_id=c40c770ab9734d38b1eba58161ad6800)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:48.975922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29dea-1f61-4242-851d-e0e7e05aa775 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:48.977560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 573/1151] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:48 2022] GET /identity/v3/users/c40c770ab9734d38b1eba58161ad6800 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:48.983620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:48.998974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:49.078360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb542b-00e4-4909-b8d6-d0a9d6d27cfe None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:49.111657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5686ea5-3cc1-4b37-826f-a6ee9c5616dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:49.112503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686ea5-3cc1-4b37-826f-a6ee9c5616dd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:49.112788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686ea5-3cc1-4b37-826f-a6ee9c5616dd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:49.113118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686ea5-3cc1-4b37-826f-a6ee9c5616dd None admin] PATH_INFO: `/v3/projects/b82bfc145af94a8ea65c00ef1ebec75f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:49.114264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5686ea5-3cc1-4b37-826f-a6ee9c5616dd None admin] RBAC: Authorizing `identity:get_project(project_id=b82bfc145af94a8ea65c00ef1ebec75f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:49.115681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5686ea5-3cc1-4b37-826f-a6ee9c5616dd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:49.117389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 579/1152] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:48 2022] GET /identity/v3/projects/b82bfc145af94a8ea65c00ef1ebec75f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:49.123200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29dea-1f61-4242-851d-e0e7e05aa775 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:49.212978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:49.219137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29dea-1f61-4242-851d-e0e7e05aa775 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:49.251463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f3f1-4d8d-4a15-9a3c-e8a706621f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:49.252340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f3f1-4d8d-4a15-9a3c-e8a706621f35 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:49.252621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f3f1-4d8d-4a15-9a3c-e8a706621f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:49.252927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f3f1-4d8d-4a15-9a3c-e8a706621f35 None admin] PATH_INFO: `/v3/projects/b82bfc145af94a8ea65c00ef1ebec75f/users/c40c770ab9734d38b1eba58161ad6800/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:49.254859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046f3f1-4d8d-4a15-9a3c-e8a706621f35 None admin] RBAC: Authorizing `identity:create_grant(project_id=b82bfc145af94a8ea65c00ef1ebec75f, user_id=c40c770ab9734d38b1eba58161ad6800, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:49.256277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046f3f1-4d8d-4a15-9a3c-e8a706621f35 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:49.268456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 574/1153] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:24:49 2022] PUT /identity/v3/projects/b82bfc145af94a8ea65c00ef1ebec75f/users/c40c770ab9734d38b1eba58161ad6800/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:51.436972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb446df9-cff5-40a0-a780-e904f8bf4715 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.437496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb446df9-cff5-40a0-a780-e904f8bf4715 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.437496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb446df9-cff5-40a0-a780-e904f8bf4715 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.438874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 580/1154] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:51.444157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d8b2-88ca-4496-9e92-3f921e4073da None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.444527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d8b2-88ca-4496-9e92-3f921e4073da None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.444720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d8b2-88ca-4496-9e92-3f921e4073da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.461925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4a42d8b2-88ca-4496-9e92-3f921e4073da None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:51.463101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4a42d8b2-88ca-4496-9e92-3f921e4073da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:51.526885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 575/1155] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:51.550290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb446df9-cff5-40a0-a780-e904f8bf4715 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.630490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.649578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb446df9-cff5-40a0-a780-e904f8bf4715 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.682085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdeacc-62e2-4b4e-87b2-88d371895aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.682860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdeacc-62e2-4b4e-87b2-88d371895aac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.683139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdeacc-62e2-4b4e-87b2-88d371895aac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.683989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdeacc-62e2-4b4e-87b2-88d371895aac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.693631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdeacc-62e2-4b4e-87b2-88d371895aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ddfdeacc-62e2-4b4e-87b2-88d371895aac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:51.701091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:51.702169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:24:51.703065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 581/1156] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:51.708349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d8b2-88ca-4496-9e92-3f921e4073da None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.788801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.804135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d8b2-88ca-4496-9e92-3f921e4073da None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.836890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.837568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.837844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.838116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.838849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:51.839150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.840532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.848681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 576/1157] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:51.854255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdeacc-62e2-4b4e-87b2-88d371895aac None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.950211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdeacc-62e2-4b4e-87b2-88d371895aac None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.982834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80c8b8-9dd4-4eab-abf4-5f62bf84f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.983669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c8b8-9dd4-4eab-abf4-5f62bf84f917 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.983951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c8b8-9dd4-4eab-abf4-5f62bf84f917 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.984226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c8b8-9dd4-4eab-abf4-5f62bf84f917 None admin] PATH_INFO: `/v3/users/c40c770ab9734d38b1eba58161ad6800` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.985402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80c8b8-9dd4-4eab-abf4-5f62bf84f917 None admin] RBAC: Authorizing `identity:get_user(user_id=c40c770ab9734d38b1eba58161ad6800)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.986817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80c8b8-9dd4-4eab-abf4-5f62bf84f917 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.988385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 582/1158] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/users/c40c770ab9734d38b1eba58161ad6800 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:51.993834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.091852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0ef12-b408-46b2-9d15-0a5cbed1ae76 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.123705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9e62-1af6-42b3-bad8-3c6e90e2d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.124333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9e62-1af6-42b3-bad8-3c6e90e2d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.124611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9e62-1af6-42b3-bad8-3c6e90e2d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.124913 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9e62-1af6-42b3-bad8-3c6e90e2d7e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.141989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.189364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9e62-1af6-42b3-bad8-3c6e90e2d7e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:52.190789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9e62-1af6-42b3-bad8-3c6e90e2d7e7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:52.283413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 577/1159] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:24:52.289220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80c8b8-9dd4-4eab-abf4-5f62bf84f917 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.302023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.387326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80c8b8-9dd4-4eab-abf4-5f62bf84f917 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.419017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd099-d805-4445-a943-8bafee1ad4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.419854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd099-d805-4445-a943-8bafee1ad4dc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.420135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd099-d805-4445-a943-8bafee1ad4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.420407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd099-d805-4445-a943-8bafee1ad4dc None admin] PATH_INFO: `/v3/projects/b82bfc145af94a8ea65c00ef1ebec75f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.421593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dd099-d805-4445-a943-8bafee1ad4dc None admin] RBAC: Authorizing `identity:get_project(project_id=b82bfc145af94a8ea65c00ef1ebec75f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:52.423018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dd099-d805-4445-a943-8bafee1ad4dc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:52.424670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 583/1160] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:24:52 2022] GET /identity/v3/projects/b82bfc145af94a8ea65c00ef1ebec75f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:52.430740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9e62-1af6-42b3-bad8-3c6e90e2d7e7 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.478069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.526618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9e62-1af6-42b3-bad8-3c6e90e2d7e7 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.559025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed93a23-78d5-4853-82fb-2afe52f0ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.559665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed93a23-78d5-4853-82fb-2afe52f0ebee None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.559948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed93a23-78d5-4853-82fb-2afe52f0ebee None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.560226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed93a23-78d5-4853-82fb-2afe52f0ebee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.561080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed93a23-78d5-4853-82fb-2afe52f0ebee None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=b82bfc145af94a8ea65c00ef1ebec75f, user.id=c40c770ab9734d38b1eba58161ad6800) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:52.561393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed93a23-78d5-4853-82fb-2afe52f0ebee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:52.562809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed93a23-78d5-4853-82fb-2afe52f0ebee None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:52.568438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 578/1161] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:24:52 2022] GET /identity/v3/role_assignments?user.id=c40c770ab9734d38b1eba58161ad6800&scope.project.id=b82bfc145af94a8ea65c00ef1ebec75f&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:54.754418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f15a-ac36-444f-91d4-76d062e15d9e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.754921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f15a-ac36-444f-91d4-76d062e15d9e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.754921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f15a-ac36-444f-91d4-76d062e15d9e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.756249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 584/1162] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:54.763005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead1b23-e2e7-4dc3-9270-8e052f03c82e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.763401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead1b23-e2e7-4dc3-9270-8e052f03c82e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.763574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead1b23-e2e7-4dc3-9270-8e052f03c82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.780506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fead1b23-e2e7-4dc3-9270-8e052f03c82e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:54.781716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fead1b23-e2e7-4dc3-9270-8e052f03c82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:54.845361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 579/1163] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:24:54.867291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f15a-ac36-444f-91d4-76d062e15d9e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.943356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.965756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f15a-ac36-444f-91d4-76d062e15d9e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.998089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb24d6-e89d-4a84-9521-ce0530da7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.998717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb24d6-e89d-4a84-9521-ce0530da7df5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.998998 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb24d6-e89d-4a84-9521-ce0530da7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.999271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb24d6-e89d-4a84-9521-ce0530da7df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:55.063057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb24d6-e89d-4a84-9521-ce0530da7df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:55.064480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb24d6-e89d-4a84-9521-ce0530da7df5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:55.136284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:55.157814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 585/1164] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:24:55.163908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead1b23-e2e7-4dc3-9270-8e052f03c82e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:55.205398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:55.259782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead1b23-e2e7-4dc3-9270-8e052f03c82e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:55.293415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb90c8-4f45-477b-a3d7-6959c876ac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:55.294211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb90c8-4f45-477b-a3d7-6959c876ac67 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:55.294497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb90c8-4f45-477b-a3d7-6959c876ac67 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:55.294772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb90c8-4f45-477b-a3d7-6959c876ac67 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:55.301895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb90c8-4f45-477b-a3d7-6959c876ac67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:55.303247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb90c8-4f45-477b-a3d7-6959c876ac67 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-17eb90c8-4f45-477b-a3d7-6959c876ac67 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:55.317938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:55.319132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:24:55.320158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 580/1165] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:24:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:55.325169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb24d6-e89d-4a84-9521-ce0530da7df5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:55.419234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb24d6-e89d-4a84-9521-ce0530da7df5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:55.451618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a289a4-3822-4158-9a64-9ebc79810fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:55.452255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a289a4-3822-4158-9a64-9ebc79810fff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:55.452532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a289a4-3822-4158-9a64-9ebc79810fff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:55.452805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a289a4-3822-4158-9a64-9ebc79810fff None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:55.453524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a289a4-3822-4158-9a64-9ebc79810fff None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:55.453824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a289a4-3822-4158-9a64-9ebc79810fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:55.455160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a289a4-3822-4158-9a64-9ebc79810fff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:55.462285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 586/1166] 10.222.0.79 () {56 vars in 1115 bytes} [Fri May 27 09:24:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:57.613678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7815979-bf75-4e8b-9ef2-a5b633e22e93 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.614227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7815979-bf75-4e8b-9ef2-a5b633e22e93 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.614227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7815979-bf75-4e8b-9ef2-a5b633e22e93 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.615532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 581/1167] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:57.620715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0720d8-3c67-4367-a008-bb1095fa16dc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.621682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0720d8-3c67-4367-a008-bb1095fa16dc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.621785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0720d8-3c67-4367-a008-bb1095fa16dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.638011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eb0720d8-3c67-4367-a008-bb1095fa16dc None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:57.639179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eb0720d8-3c67-4367-a008-bb1095fa16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:57.672172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:57.702317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 587/1168] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:24:57.724578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7815979-bf75-4e8b-9ef2-a5b633e22e93 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:57.822842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7815979-bf75-4e8b-9ef2-a5b633e22e93 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:57.824358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:57.856419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47416d93-5fa9-470b-a659-0a6a6a5920a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:57.857088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416d93-5fa9-470b-a659-0a6a6a5920a2 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.857374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416d93-5fa9-470b-a659-0a6a6a5920a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.857652 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416d93-5fa9-470b-a659-0a6a6a5920a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.858392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47416d93-5fa9-470b-a659-0a6a6a5920a2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:57.859744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47416d93-5fa9-470b-a659-0a6a6a5920a2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:57.873862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 582/1169] 10.222.0.79 () {60 vars in 1138 bytes} [Fri May 27 09:24:57 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:00.069378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745586f-823e-4d43-a95b-df89d8b89c17 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.069912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745586f-823e-4d43-a95b-df89d8b89c17 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.069912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745586f-823e-4d43-a95b-df89d8b89c17 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.071291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 588/1170] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:00.077111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc54be-982c-4dc6-9451-bcf42fbb79e3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.077534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc54be-982c-4dc6-9451-bcf42fbb79e3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.077676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc54be-982c-4dc6-9451-bcf42fbb79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.094883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-63bc54be-982c-4dc6-9451-bcf42fbb79e3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:00.096058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-63bc54be-982c-4dc6-9451-bcf42fbb79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:00.160398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 583/1171] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:25:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:25:00.183806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745586f-823e-4d43-a95b-df89d8b89c17 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.281990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745586f-823e-4d43-a95b-df89d8b89c17 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.315783 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128fdbe-92cd-45ae-9f64-e850ba599173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.316639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128fdbe-92cd-45ae-9f64-e850ba599173 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.316959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128fdbe-92cd-45ae-9f64-e850ba599173 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.317242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128fdbe-92cd-45ae-9f64-e850ba599173 None admin] PATH_INFO: `/v3/domains/20a9a22ecafb44579659ef529b1e0b57` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.327867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128fdbe-92cd-45ae-9f64-e850ba599173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=20a9a22ecafb44579659ef529b1e0b57)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:00.329301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128fdbe-92cd-45ae-9f64-e850ba599173 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:00.330925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 589/1172] 10.222.0.79 () {56 vars in 1183 bytes} [Fri May 27 09:25:00 2022] GET /identity/v3/domains/20a9a22ecafb44579659ef529b1e0b57 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:00.336531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc54be-982c-4dc6-9451-bcf42fbb79e3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.421966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:00.430746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc54be-982c-4dc6-9451-bcf42fbb79e3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.463810 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf3ac2-9301-4676-836b-057753f5e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.464478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf3ac2-9301-4676-836b-057753f5e706 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.464764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf3ac2-9301-4676-836b-057753f5e706 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.465063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf3ac2-9301-4676-836b-057753f5e706 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.465763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf3ac2-9301-4676-836b-057753f5e706 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:00.467178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf3ac2-9301-4676-836b-057753f5e706 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:00.490456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 584/1173] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:25:00 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:25:02.689551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57265412-e3f5-4d44-915e-c75f60b00ca6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:02.690066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57265412-e3f5-4d44-915e-c75f60b00ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:02.690066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57265412-e3f5-4d44-915e-c75f60b00ca6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:02.691397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 590/1174] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:02.696671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f7fe0-f3b1-4919-9466-4a388563844b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:02.697119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f7fe0-f3b1-4919-9466-4a388563844b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:02.697232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f7fe0-f3b1-4919-9466-4a388563844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:02.713855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-656f7fe0-f3b1-4919-9466-4a388563844b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:02.715513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-656f7fe0-f3b1-4919-9466-4a388563844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:02.778728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 585/1175] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:25:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:25:02.803284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57265412-e3f5-4d44-915e-c75f60b00ca6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:02.835368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:02.904318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57265412-e3f5-4d44-915e-c75f60b00ca6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:02.936522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba110526-f89a-4178-80d7-645448ed1509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:02.937402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110526-f89a-4178-80d7-645448ed1509 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:02.937688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110526-f89a-4178-80d7-645448ed1509 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:02.937964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110526-f89a-4178-80d7-645448ed1509 None admin] PATH_INFO: `/v3/domains/20a9a22ecafb44579659ef529b1e0b57` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:02.939135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba110526-f89a-4178-80d7-645448ed1509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=20a9a22ecafb44579659ef529b1e0b57)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:02.940614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba110526-f89a-4178-80d7-645448ed1509 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:02.942200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 591/1176] 10.222.0.79 () {56 vars in 1183 bytes} [Fri May 27 09:25:02 2022] GET /identity/v3/domains/20a9a22ecafb44579659ef529b1e0b57 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:02.947845 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f7fe0-f3b1-4919-9466-4a388563844b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:03.019158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:03.044694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f7fe0-f3b1-4919-9466-4a388563844b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:03.077293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37f6af-ac47-494d-a6de-5c6c3c0db76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:03.077953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f6af-ac47-494d-a6de-5c6c3c0db76b None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.078237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f6af-ac47-494d-a6de-5c6c3c0db76b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.078514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f6af-ac47-494d-a6de-5c6c3c0db76b None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.079211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37f6af-ac47-494d-a6de-5c6c3c0db76b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:03.080630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37f6af-ac47-494d-a6de-5c6c3c0db76b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:03.100443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 586/1177] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:25:02 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:05.305463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaa523-e15b-4789-bf6a-5a95b3c53588 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.305912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaa523-e15b-4789-bf6a-5a95b3c53588 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.306013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaa523-e15b-4789-bf6a-5a95b3c53588 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.307434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 592/1178] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:05.313343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9408-7304-439f-b9c0-4065bb1e2d42 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.313753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9408-7304-439f-b9c0-4065bb1e2d42 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.313898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9408-7304-439f-b9c0-4065bb1e2d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.330257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-063f9408-7304-439f-b9c0-4065bb1e2d42 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:05.331443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-063f9408-7304-439f-b9c0-4065bb1e2d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:05.395487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 587/1179] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:25:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:25:05.418583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaa523-e15b-4789-bf6a-5a95b3c53588 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.517035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:05.521101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaa523-e15b-4789-bf6a-5a95b3c53588 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.554937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88988f-806e-4e1e-88cd-db9d4677c4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.555650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88988f-806e-4e1e-88cd-db9d4677c4ef None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.555932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88988f-806e-4e1e-88cd-db9d4677c4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.556209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88988f-806e-4e1e-88cd-db9d4677c4ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.565994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88988f-806e-4e1e-88cd-db9d4677c4ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6b88988f-806e-4e1e-88cd-db9d4677c4ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:05.573715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:05.574870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:25:05.575852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 593/1180] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:05.580747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f9408-7304-439f-b9c0-4065bb1e2d42 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.637443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:05.677290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f9408-7304-439f-b9c0-4065bb1e2d42 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.709215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.709872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.710158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.710438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.711179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:05.711488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:05.713133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:05.721457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 588/1181] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:05.727034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88988f-806e-4e1e-88cd-db9d4677c4ef None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.825629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88988f-806e-4e1e-88cd-db9d4677c4ef None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.858144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06801885-9517-45a7-939d-da37ceddd40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.858993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801885-9517-45a7-939d-da37ceddd40a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.859272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801885-9517-45a7-939d-da37ceddd40a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.859544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801885-9517-45a7-939d-da37ceddd40a None admin] PATH_INFO: `/v3/users/c8c10fc516f342fdb4c9ee59c68ded74` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.871995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06801885-9517-45a7-939d-da37ceddd40a None admin] RBAC: Authorizing `identity:get_user(user_id=c8c10fc516f342fdb4c9ee59c68ded74)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:05.873449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06801885-9517-45a7-939d-da37ceddd40a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:05.875066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 594/1182] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/users/c8c10fc516f342fdb4c9ee59c68ded74 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:05.880775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.978631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90e319-9c9d-4a52-afd2-0c7b2b6a0c7c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.999666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:06.011444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c089e-f285-4ee1-b293-91f26235e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:06.012082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c089e-f285-4ee1-b293-91f26235e628 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:06.012364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c089e-f285-4ee1-b293-91f26235e628 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:06.012637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c089e-f285-4ee1-b293-91f26235e628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:06.076619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c089e-f285-4ee1-b293-91f26235e628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:06.078034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c089e-f285-4ee1-b293-91f26235e628 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:06.174561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 589/1183] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:25:06.180493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06801885-9517-45a7-939d-da37ceddd40a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:06.199125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:06.275418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06801885-9517-45a7-939d-da37ceddd40a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:06.310058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b2563-aae2-4751-af3b-fb3940acc940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:06.310907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2563-aae2-4751-af3b-fb3940acc940 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:06.311184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2563-aae2-4751-af3b-fb3940acc940 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:06.311457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2563-aae2-4751-af3b-fb3940acc940 None admin] PATH_INFO: `/v3/projects/efc2d09a1f4f4a47bf1f00a9391a79c1` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:06.312602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b2563-aae2-4751-af3b-fb3940acc940 None admin] RBAC: Authorizing `identity:get_project(project_id=efc2d09a1f4f4a47bf1f00a9391a79c1)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:06.314053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b2563-aae2-4751-af3b-fb3940acc940 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:06.315719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 595/1184] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:25:06 2022] GET /identity/v3/projects/efc2d09a1f4f4a47bf1f00a9391a79c1 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:06.321807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c089e-f285-4ee1-b293-91f26235e628 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:06.345571 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:06.419278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c089e-f285-4ee1-b293-91f26235e628 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:06.454009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f48be-30ef-4462-81d2-302c9d38a2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:06.455488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f48be-30ef-4462-81d2-302c9d38a2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:06.455773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f48be-30ef-4462-81d2-302c9d38a2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:06.456049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f48be-30ef-4462-81d2-302c9d38a2d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:06.456893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f48be-30ef-4462-81d2-302c9d38a2d4 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=efc2d09a1f4f4a47bf1f00a9391a79c1, user.id=c8c10fc516f342fdb4c9ee59c68ded74) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:06.457209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f48be-30ef-4462-81d2-302c9d38a2d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:06.459479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f48be-30ef-4462-81d2-302c9d38a2d4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:06.465552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 590/1185] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:25:06 2022] GET /identity/v3/role_assignments?user.id=c8c10fc516f342fdb4c9ee59c68ded74&scope.project.id=efc2d09a1f4f4a47bf1f00a9391a79c1&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:08.584246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07024e9-8fbf-4acd-814a-0ffabb847535 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.584753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07024e9-8fbf-4acd-814a-0ffabb847535 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.584753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07024e9-8fbf-4acd-814a-0ffabb847535 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.586135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 596/1186] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:08.592121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095935c6-43ee-4cbf-8e3d-3c27877ab185 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.592508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095935c6-43ee-4cbf-8e3d-3c27877ab185 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.592676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095935c6-43ee-4cbf-8e3d-3c27877ab185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.609549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-095935c6-43ee-4cbf-8e3d-3c27877ab185 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:08.610713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-095935c6-43ee-4cbf-8e3d-3c27877ab185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:08.674817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 591/1187] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:25:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:25:08.696867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07024e9-8fbf-4acd-814a-0ffabb847535 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:08.780154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:08.796005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07024e9-8fbf-4acd-814a-0ffabb847535 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:08.829837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a2530-0340-4168-a446-5f1b814374ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:08.830612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a2530-0340-4168-a446-5f1b814374ea None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.830898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a2530-0340-4168-a446-5f1b814374ea None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.831176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a2530-0340-4168-a446-5f1b814374ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.842086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a2530-0340-4168-a446-5f1b814374ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-450a2530-0340-4168-a446-5f1b814374ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:08.849645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:08.850739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:25:08.851807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 597/1188] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:08.856726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095935c6-43ee-4cbf-8e3d-3c27877ab185 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:08.874205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:08.952725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095935c6-43ee-4cbf-8e3d-3c27877ab185 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:08.985591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:08.986248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.986532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.986818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.987560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:08.987866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:08.989256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:08.997104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 592/1189] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:09.003155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a2530-0340-4168-a446-5f1b814374ea None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:09.099670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a2530-0340-4168-a446-5f1b814374ea None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:09.131162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bafbd-5f45-465a-9fdc-1a1c3c3d2734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:09.132010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bafbd-5f45-465a-9fdc-1a1c3c3d2734 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.132294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bafbd-5f45-465a-9fdc-1a1c3c3d2734 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.132578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bafbd-5f45-465a-9fdc-1a1c3c3d2734 None admin] PATH_INFO: `/v3/users/c8c10fc516f342fdb4c9ee59c68ded74` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.133777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bafbd-5f45-465a-9fdc-1a1c3c3d2734 None admin] RBAC: Authorizing `identity:get_user(user_id=c8c10fc516f342fdb4c9ee59c68ded74)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:09.135191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bafbd-5f45-465a-9fdc-1a1c3c3d2734 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:09.137324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 598/1190] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:25:09 2022] GET /identity/v3/users/c8c10fc516f342fdb4c9ee59c68ded74 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:09.142833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:09.218072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:09.238537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d607f3-fcaf-4bf6-bf5a-6821caf648d2 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:09.270562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c504ed3-db2b-4764-919f-743f88aeebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:09.271394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504ed3-db2b-4764-919f-743f88aeebcf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.271672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504ed3-db2b-4764-919f-743f88aeebcf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.271941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504ed3-db2b-4764-919f-743f88aeebcf None admin] PATH_INFO: `/v3/projects/efc2d09a1f4f4a47bf1f00a9391a79c1` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.273109 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c504ed3-db2b-4764-919f-743f88aeebcf None admin] RBAC: Authorizing `identity:get_project(project_id=efc2d09a1f4f4a47bf1f00a9391a79c1)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:09.274535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c504ed3-db2b-4764-919f-743f88aeebcf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:09.276205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 593/1191] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:25:09 2022] GET /identity/v3/projects/efc2d09a1f4f4a47bf1f00a9391a79c1 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:09.281901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bafbd-5f45-465a-9fdc-1a1c3c3d2734 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:09.297578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:09.380460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bafbd-5f45-465a-9fdc-1a1c3c3d2734 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:09.412330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d772c99-5c8f-463e-9273-f5951e7af5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:09.413247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d772c99-5c8f-463e-9273-f5951e7af5ea None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.413529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d772c99-5c8f-463e-9273-f5951e7af5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.413802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d772c99-5c8f-463e-9273-f5951e7af5ea None admin] PATH_INFO: `/v3/projects/efc2d09a1f4f4a47bf1f00a9391a79c1/users/c8c10fc516f342fdb4c9ee59c68ded74/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.415724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d772c99-5c8f-463e-9273-f5951e7af5ea None admin] RBAC: Authorizing `identity:create_grant(project_id=efc2d09a1f4f4a47bf1f00a9391a79c1, user_id=c8c10fc516f342fdb4c9ee59c68ded74, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:09.417193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d772c99-5c8f-463e-9273-f5951e7af5ea None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:09.429415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 599/1192] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:25:09 2022] PUT /identity/v3/projects/efc2d09a1f4f4a47bf1f00a9391a79c1/users/c8c10fc516f342fdb4c9ee59c68ded74/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:11.581300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcc294-e4ae-4726-a656-0989c6e9b4e8 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.581800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcc294-e4ae-4726-a656-0989c6e9b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.581800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcc294-e4ae-4726-a656-0989c6e9b4e8 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.583156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 594/1193] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:11.589183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1938b-46cd-4db2-bd91-05cb14b8970c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.589579 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1938b-46cd-4db2-bd91-05cb14b8970c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.589837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1938b-46cd-4db2-bd91-05cb14b8970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.606515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-68b1938b-46cd-4db2-bd91-05cb14b8970c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:11.607694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-68b1938b-46cd-4db2-bd91-05cb14b8970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:11.670650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 600/1194] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:25:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:25:11.693447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcc294-e4ae-4726-a656-0989c6e9b4e8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.793268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcc294-e4ae-4726-a656-0989c6e9b4e8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.825635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64b73-fd55-4b60-ae23-e2c51f1af29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.826411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64b73-fd55-4b60-ae23-e2c51f1af29c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.826694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64b73-fd55-4b60-ae23-e2c51f1af29c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.826971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64b73-fd55-4b60-ae23-e2c51f1af29c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.837663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d64b73-fd55-4b60-ae23-e2c51f1af29c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b9d64b73-fd55-4b60-ae23-e2c51f1af29c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:11.845761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:11.846833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:25:11.848060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 595/1195] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:25:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:11.852810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1938b-46cd-4db2-bd91-05cb14b8970c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.855879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:11.949516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1938b-46cd-4db2-bd91-05cb14b8970c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.982269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.982952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.983236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.983512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.984246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:11.984553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:11.985959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:11.993761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 601/1196] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:25:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:11.999427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64b73-fd55-4b60-ae23-e2c51f1af29c None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:12.008100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:12.096407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64b73-fd55-4b60-ae23-e2c51f1af29c None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:12.128036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5257b1-7d26-4a94-a090-1a895109421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:12.128902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5257b1-7d26-4a94-a090-1a895109421a None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:12.129181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5257b1-7d26-4a94-a090-1a895109421a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:12.129449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5257b1-7d26-4a94-a090-1a895109421a None admin] PATH_INFO: `/v3/users/c8c10fc516f342fdb4c9ee59c68ded74` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:12.130607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5257b1-7d26-4a94-a090-1a895109421a None admin] RBAC: Authorizing `identity:get_user(user_id=c8c10fc516f342fdb4c9ee59c68ded74)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:12.132019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5257b1-7d26-4a94-a090-1a895109421a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:12.133650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 596/1197] 10.222.0.79 () {56 vars in 1177 bytes} [Fri May 27 09:25:11 2022] GET /identity/v3/users/c8c10fc516f342fdb4c9ee59c68ded74 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:12.139886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:12.203315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:12.236380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a482-3804-4f11-a649-bd9f44acfd03 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:12.268483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a76d2-3ac5-406d-93cf-2d3c54130081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:12.269143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a76d2-3ac5-406d-93cf-2d3c54130081 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:12.269423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a76d2-3ac5-406d-93cf-2d3c54130081 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:12.269696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a76d2-3ac5-406d-93cf-2d3c54130081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:12.334811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a76d2-3ac5-406d-93cf-2d3c54130081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:12.336282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a76d2-3ac5-406d-93cf-2d3c54130081 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:12.396546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:12.430549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 602/1198] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:25:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:25:12.436872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5257b1-7d26-4a94-a090-1a895109421a None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:12.508707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:12.533036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5257b1-7d26-4a94-a090-1a895109421a None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:12.565849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88067ef-505a-4ebf-ae7b-1d010a379bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:12.566698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88067ef-505a-4ebf-ae7b-1d010a379bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:12.566980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88067ef-505a-4ebf-ae7b-1d010a379bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:12.567255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88067ef-505a-4ebf-ae7b-1d010a379bf0 None admin] PATH_INFO: `/v3/projects/efc2d09a1f4f4a47bf1f00a9391a79c1` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:12.568416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88067ef-505a-4ebf-ae7b-1d010a379bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=efc2d09a1f4f4a47bf1f00a9391a79c1)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:12.569873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88067ef-505a-4ebf-ae7b-1d010a379bf0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:12.571551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 597/1199] 10.222.0.79 () {56 vars in 1186 bytes} [Fri May 27 09:25:12 2022] GET /identity/v3/projects/efc2d09a1f4f4a47bf1f00a9391a79c1 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:12.577449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a76d2-3ac5-406d-93cf-2d3c54130081 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:12.671811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a76d2-3ac5-406d-93cf-2d3c54130081 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:12.704304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c550f-2ce0-41ac-b4ff-d5d0cff7c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:12.705016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c550f-2ce0-41ac-b4ff-d5d0cff7c863 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:12.705306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c550f-2ce0-41ac-b4ff-d5d0cff7c863 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:12.705585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c550f-2ce0-41ac-b4ff-d5d0cff7c863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:12.706405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c550f-2ce0-41ac-b4ff-d5d0cff7c863 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=efc2d09a1f4f4a47bf1f00a9391a79c1, user.id=c8c10fc516f342fdb4c9ee59c68ded74) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:12.706719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c550f-2ce0-41ac-b4ff-d5d0cff7c863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:12.708146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c550f-2ce0-41ac-b4ff-d5d0cff7c863 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:12.714104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 603/1200] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:25:12 2022] GET /identity/v3/role_assignments?user.id=c8c10fc516f342fdb4c9ee59c68ded74&scope.project.id=efc2d09a1f4f4a47bf1f00a9391a79c1&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:22.561935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=29 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:22.711250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=85 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.044994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366acd-f892-49e9-aa26-76f8b9a58efc None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.045604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366acd-f892-49e9-aa26-76f8b9a58efc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.045604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27366acd-f892-49e9-aa26-76f8b9a58efc None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.047133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 598/1201] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:12.052804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed545-5e14-4bdb-bae6-267c127dd133 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.053291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed545-5e14-4bdb-bae6-267c127dd133 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.053390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ed545-5e14-4bdb-bae6-267c127dd133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.075041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8d3ed545-5e14-4bdb-bae6-267c127dd133 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:12.076259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8d3ed545-5e14-4bdb-bae6-267c127dd133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:12.156577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 604/1202] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:12.183546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27366acd-f892-49e9-aa26-76f8b9a58efc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.317672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27366acd-f892-49e9-aa26-76f8b9a58efc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.361618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.362532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.362849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.363218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.378298 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.379981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:12.404555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:12.405695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:12.406703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:12.406703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:12.406703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:12.406703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:12.411097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 599/1203] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:12.414474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ed545-5e14-4bdb-bae6-267c127dd133 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.545092 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ed545-5e14-4bdb-bae6-267c127dd133 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.586652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.593200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baf399-bb7d-4ca3-84a7-3ead8b908c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.593887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf399-bb7d-4ca3-84a7-3ead8b908c0f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.594229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf399-bb7d-4ca3-84a7-3ead8b908c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.594813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf399-bb7d-4ca3-84a7-3ead8b908c0f None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.595534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baf399-bb7d-4ca3-84a7-3ead8b908c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:12.595888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baf399-bb7d-4ca3-84a7-3ead8b908c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.597338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baf399-bb7d-4ca3-84a7-3ead8b908c0f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.616874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 605/1204] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:12.620022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.692189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.754006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3af4a-9553-453f-808d-0651631d8799 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.797301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b9283-4f29-4476-9a69-2ee46b210268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.797935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9283-4f29-4476-9a69-2ee46b210268 None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.798289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9283-4f29-4476-9a69-2ee46b210268 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.798607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9283-4f29-4476-9a69-2ee46b210268 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.799345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b9283-4f29-4476-9a69-2ee46b210268 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.800854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b9283-4f29-4476-9a69-2ee46b210268 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.827038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 600/1205] 10.222.0.79 () {60 vars in 1132 bytes} [Fri May 27 09:26:12 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:15.370671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c138e5-600f-4e87-bedd-13d8f033c395 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.371255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c138e5-600f-4e87-bedd-13d8f033c395 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.371255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c138e5-600f-4e87-bedd-13d8f033c395 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.372639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 606/1206] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:15.378793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de266d5-ae62-481c-8ae4-7fbebbf93fc4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.379252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de266d5-ae62-481c-8ae4-7fbebbf93fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.379521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de266d5-ae62-481c-8ae4-7fbebbf93fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.399547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8de266d5-ae62-481c-8ae4-7fbebbf93fc4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:15.401529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8de266d5-ae62-481c-8ae4-7fbebbf93fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:15.487182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 601/1207] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:15.514205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c138e5-600f-4e87-bedd-13d8f033c395 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.633046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c138e5-600f-4e87-bedd-13d8f033c395 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:15.671288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0395b01-4abb-4d89-b97e-880db5ab2f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:15.672099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0395b01-4abb-4d89-b97e-880db5ab2f80 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.672364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0395b01-4abb-4d89-b97e-880db5ab2f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.672646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0395b01-4abb-4d89-b97e-880db5ab2f80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.684161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0395b01-4abb-4d89-b97e-880db5ab2f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c0395b01-4abb-4d89-b97e-880db5ab2f80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:15.692923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:15.695287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:15.696183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 607/1208] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:15.701248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de266d5-ae62-481c-8ae4-7fbebbf93fc4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.748559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:15.818458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de266d5-ae62-481c-8ae4-7fbebbf93fc4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:15.857959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:15.858628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.858910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.859187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.859936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:15.860246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:15.861676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:15.872877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 602/1209] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:15.877767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0395b01-4abb-4d89-b97e-880db5ab2f80 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.936862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:15.998133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0395b01-4abb-4d89-b97e-880db5ab2f80 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.037850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.038762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.038906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.039188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.052110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.053926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:16.073522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:16.074800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:16.075731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:16.075731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:16.075731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:16.075731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:16.075731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 608/1210] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:16.081084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:16.193370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:16.197261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696cc83-32ab-4543-851a-bb8a2aa58619 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.235946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.236929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.237221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.237609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.238298 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:16.238585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.239953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.260033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 603/1211] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:16.261620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:16.392606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157838f-182a-4080-8a25-72034698bb23 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.394346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:16.432364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.433201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.433486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.433767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.443308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.444969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:16.462192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:16.463901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:16.470669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 609/1212] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:16.471318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:16.599642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40082127-7a3a-4211-b518-a5defef673b5 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.641530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.642366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.642639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.642914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.643961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:16.644317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.646036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.666144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 604/1213] 10.222.0.79 () {56 vars in 1143 bytes} [Fri May 27 09:26:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:16.672368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:16.788869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b1d6-43f9-4080-8e7d-87946813c728 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.827457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c980146-09f7-41b0-a847-eb672e0ba58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.828148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c980146-09f7-41b0-a847-eb672e0ba58c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.828436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c980146-09f7-41b0-a847-eb672e0ba58c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.828717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c980146-09f7-41b0-a847-eb672e0ba58c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.863340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:16.908349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c980146-09f7-41b0-a847-eb672e0ba58c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.909855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c980146-09f7-41b0-a847-eb672e0ba58c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:17.024300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 610/1214] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:26:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:17.026229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:17.046307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:17.141380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bee80-812c-4f21-995c-86e67df87cdb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:17.180908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:17.182396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.182780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.183159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.194335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:17.196225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:17.218403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:17.219593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:17.220759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:17.220759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:17.220759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:17.220759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:17.225828 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 605/1215] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:17.226907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c980146-09f7-41b0-a847-eb672e0ba58c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:17.296814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:17.342418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c980146-09f7-41b0-a847-eb672e0ba58c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:17.379743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:17.380794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.381202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.381578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.382404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:17.382886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:17.384394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:17.401986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 611/1216] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:17.403932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:17.479608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:17.515404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25d06-7a46-4864-84d8-83f97787633b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:17.554494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:17.555326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.555614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.555890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.564269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:17.566214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:17.584399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:17.585511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:17.586702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:17.586702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:17.586702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:17.586702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:17.586702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:17.586702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:17.586702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:17.586702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:17.592868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 606/1217] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:17.593211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:17.709081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80de70d-791a-4fa1-be6e-2cd814cf6f06 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:17.734195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:17.758365 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01331d68-ddd9-4380-a3a7-f9abea585bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:17.759039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01331d68-ddd9-4380-a3a7-f9abea585bce None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.759324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01331d68-ddd9-4380-a3a7-f9abea585bce None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.759603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01331d68-ddd9-4380-a3a7-f9abea585bce None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.760387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01331d68-ddd9-4380-a3a7-f9abea585bce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:17.760703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01331d68-ddd9-4380-a3a7-f9abea585bce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:17.762173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01331d68-ddd9-4380-a3a7-f9abea585bce None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:17.776176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 612/1218] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:17.782180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:17.910262 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1946ce-968a-496e-9958-3438303de76b None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:17.941328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:17.949367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c9b9-aa21-40e7-b399-3891c3e083f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:17.950138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c9b9-aa21-40e7-b399-3891c3e083f3 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.950555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c9b9-aa21-40e7-b399-3891c3e083f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.950888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c9b9-aa21-40e7-b399-3891c3e083f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.951860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c9b9-aa21-40e7-b399-3891c3e083f3 None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=e79a5d5bbecb4835b3e8f4128b347aeb) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:17.952179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c9b9-aa21-40e7-b399-3891c3e083f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:17.953759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c9b9-aa21-40e7-b399-3891c3e083f3 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:17.968858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 607/1219] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:26:17 2022] GET /identity/v3/role_assignments?user.id=e79a5d5bbecb4835b3e8f4128b347aeb&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:20.288923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4fae7-9111-4d5b-aca8-98a1a67d97e6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.288923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4fae7-9111-4d5b-aca8-98a1a67d97e6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.289530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4fae7-9111-4d5b-aca8-98a1a67d97e6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.294978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 613/1220] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:20.297331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044109-aa07-4bd4-a792-e37021f97b44 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.297808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044109-aa07-4bd4-a792-e37021f97b44 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.297894 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044109-aa07-4bd4-a792-e37021f97b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.316387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e7044109-aa07-4bd4-a792-e37021f97b44 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:20.317662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e7044109-aa07-4bd4-a792-e37021f97b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:20.387728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 608/1221] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:20.409917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4fae7-9111-4d5b-aca8-98a1a67d97e6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:20.513621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4fae7-9111-4d5b-aca8-98a1a67d97e6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:20.548526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd78a-e958-4e05-8a35-d4f71e28c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:20.549648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd78a-e958-4e05-8a35-d4f71e28c7bf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.550141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd78a-e958-4e05-8a35-d4f71e28c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.550589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd78a-e958-4e05-8a35-d4f71e28c7bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.561273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd78a-e958-4e05-8a35-d4f71e28c7bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7dacd78a-e958-4e05-8a35-d4f71e28c7bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:20.568860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:20.569967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:20.570858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 614/1222] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:26:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:20.576188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044109-aa07-4bd4-a792-e37021f97b44 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:20.681383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044109-aa07-4bd4-a792-e37021f97b44 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:20.705694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:20.717728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:20.718396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.718677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.718958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.719699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:20.720006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:20.721399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:20.730198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 609/1223] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:26:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:20.735852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd78a-e958-4e05-8a35-d4f71e28c7bf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:20.780555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:20.840013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd78a-e958-4e05-8a35-d4f71e28c7bf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:20.878153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:20.878999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.879332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.879640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.890736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:20.892245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:20.909985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:20.911245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:20.912584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:20.912584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:20.912584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:20.912584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:20.912584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 615/1224] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:20.917918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.021000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754aabc-b7d2-400c-9ce3-7532c63d1e40 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.055057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.055722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.056021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.056322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.057098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:21.057392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.058761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.072164 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 610/1225] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:21.077986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.185132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.192400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc50a34-b4af-48ee-9f01-81fa4ce9d538 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.230346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.231149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.231431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.231711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.238946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.240500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:21.256429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:21.257677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:21.258803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 616/1226] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:21.264262 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.319987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.377968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f253d33-608f-4fdb-b217-9a28d06646cf None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.416603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.417405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.417686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.417961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.418792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:21.419101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.420525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.438515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 611/1227] 10.222.0.79 () {56 vars in 1143 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:21.445451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.554304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27811a-4978-4350-be83-96351dd8302b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.591409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.592216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.592502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.592786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.603347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.604801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:21.624475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:21.625850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:21.626767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:21.626767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:21.626767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:21.626767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:21.626767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 617/1228] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:21.631734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.746907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8dcfa-83d8-478c-880b-faf9de5bb140 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.749219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.786750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.787567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.788036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.788318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.789262 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:21.789573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.790977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.803593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 612/1229] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:21.810168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.819994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.916986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c13db-82c9-452f-8da1-b119a99f7acf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.954676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.955476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.955760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.956368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.963850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.965497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:21.980454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:21.981589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:21.982818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:21.982818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:21.982818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:21.982818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:21.982818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:21.982818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:21.982818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:21.982818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:21.986455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 618/1230] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:21.987640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:22.101332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a28f-29c7-40a0-beb5-2983432b89b9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.141060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243f6ec-c1bd-468f-8696-b80d1245f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:22.141735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f6ec-c1bd-468f-8696-b80d1245f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.142135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f6ec-c1bd-468f-8696-b80d1245f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.142318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f6ec-c1bd-468f-8696-b80d1245f9c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.143170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243f6ec-c1bd-468f-8696-b80d1245f9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:22.143460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243f6ec-c1bd-468f-8696-b80d1245f9c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:22.144905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243f6ec-c1bd-468f-8696-b80d1245f9c1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:22.157291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 613/1231] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:22.163549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:22.236332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:22.274801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b3b1-6f63-4b11-a25e-5f4f7ec3ab96 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.316881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db53bd5-544f-4967-b9f1-05de464e0c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:22.317766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db53bd5-544f-4967-b9f1-05de464e0c95 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.318047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db53bd5-544f-4967-b9f1-05de464e0c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.318317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db53bd5-544f-4967-b9f1-05de464e0c95 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/e79a5d5bbecb4835b3e8f4128b347aeb/roles/d8b62a0f71124aa1bd3c62e2923db913` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.334940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db53bd5-544f-4967-b9f1-05de464e0c95 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=e79a5d5bbecb4835b3e8f4128b347aeb, role_id=d8b62a0f71124aa1bd3c62e2923db913)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:22.336697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db53bd5-544f-4967-b9f1-05de464e0c95 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:22.350427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 619/1232] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:26:22 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/e79a5d5bbecb4835b3e8f4128b347aeb/roles/d8b62a0f71124aa1bd3c62e2923db913 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:26:24.655809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246c8d-11e0-4987-b887-c0e140410130 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.656308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246c8d-11e0-4987-b887-c0e140410130 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.656308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246c8d-11e0-4987-b887-c0e140410130 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.657687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 614/1233] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:24.663385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5a87-a0ea-4a2f-b8ca-4322e0efa53e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.663814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5a87-a0ea-4a2f-b8ca-4322e0efa53e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.663942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5a87-a0ea-4a2f-b8ca-4322e0efa53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.682830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4c6e5a87-a0ea-4a2f-b8ca-4322e0efa53e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:24.684198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4c6e5a87-a0ea-4a2f-b8ca-4322e0efa53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:24.758321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 620/1234] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:24.784738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b246c8d-11e0-4987-b887-c0e140410130 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:24.816304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:24.901094 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b246c8d-11e0-4987-b887-c0e140410130 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:24.938868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87fa6-7625-4ecb-9762-a7c3955948ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:24.939711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87fa6-7625-4ecb-9762-a7c3955948ca None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.940059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87fa6-7625-4ecb-9762-a7c3955948ca None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.940450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87fa6-7625-4ecb-9762-a7c3955948ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.953485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87fa6-7625-4ecb-9762-a7c3955948ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-d4d87fa6-7625-4ecb-9762-a7c3955948ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:24.962089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:24.968720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:24.969860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 615/1235] 10.222.0.79 () {56 vars in 1102 bytes} [Fri May 27 09:26:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:24.970760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e5a87-a0ea-4a2f-b8ca-4322e0efa53e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.021603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:25.079557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e5a87-a0ea-4a2f-b8ca-4322e0efa53e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.120863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.121533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.121772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.122046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.122796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:25.123171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.124503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.133866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 621/1236] 10.222.0.79 () {56 vars in 1103 bytes} [Fri May 27 09:26:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:25.140519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87fa6-7625-4ecb-9762-a7c3955948ca None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.229722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:25.246083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87fa6-7625-4ecb-9762-a7c3955948ca None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.283182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.284099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.284378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.284749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.296414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.297890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:25.316860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:25.318843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:25.320545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:25.320545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:25.320545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:25.320545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:25.320545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 616/1237] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:25.324423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.448347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31932d1-1535-4f05-a6b8-ae8aa8cd60b7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.457320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:25.484237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.484934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.485226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.485506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.486309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:25.486624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.488059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.501540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 622/1238] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:25.507266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.614951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24a9cb-9670-4f80-9446-fb502f677bf6 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.651810 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.652633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.654100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.654100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.656130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:25.662049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.663527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:25.679540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:25.680721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:25.682434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 617/1239] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:25.687247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.798500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ed5bb-5ad8-4cbc-9edb-f36e7f17d4af None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.836677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.837426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.837703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.837991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.838832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:25.839138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.840571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.858487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 623/1240] 10.222.0.79 () {56 vars in 1143 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:25.864384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.972087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aaa60-2886-4ff8-89c7-330d0c166aeb None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:26.006185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9723253-35c4-4e18-8eb9-241ae3fbdc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:26.006827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9723253-35c4-4e18-8eb9-241ae3fbdc82 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:26.007184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9723253-35c4-4e18-8eb9-241ae3fbdc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:26.007457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9723253-35c4-4e18-8eb9-241ae3fbdc82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:26.070551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:26.078764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9723253-35c4-4e18-8eb9-241ae3fbdc82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:26.080539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9723253-35c4-4e18-8eb9-241ae3fbdc82 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:26.193117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 618/1241] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:26.199026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:26.227134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:26.304210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0b8b-6459-435c-a2a1-b3b3f6fad273 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:26.342956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:26.343700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:26.343970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:26.344298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:26.356330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:26.357911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:26.376699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:26.377910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:26.379022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:26.379022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:26.379022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:26.379022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:26.379022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 624/1242] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:26.385144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9723253-35c4-4e18-8eb9-241ae3fbdc82 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:26.487386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:26.494092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9723253-35c4-4e18-8eb9-241ae3fbdc82 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:26.531256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:26.532062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:26.532335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:26.532640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:26.533498 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:26.533859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:26.535396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:26.548043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 619/1243] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:26.553738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:26.637308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:26.660243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd2c44-4745-4634-86f6-cd9381f3e206 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:26.701291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:26.702559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:26.703093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:26.703585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:26.711521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:26.713793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:26.728957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:26.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:26.731241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 625/1244] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:26.738160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:26.845446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5e62-179c-41ab-95a2-6d5c6a0a088f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:26.880794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a4a49-f67d-4828-82c3-acb11579166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:26.881481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4a49-f67d-4828-82c3-acb11579166c None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:26.881766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4a49-f67d-4828-82c3-acb11579166c None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:26.882042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4a49-f67d-4828-82c3-acb11579166c None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:26.882823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a4a49-f67d-4828-82c3-acb11579166c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:26.883133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a4a49-f67d-4828-82c3-acb11579166c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:26.885149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a4a49-f67d-4828-82c3-acb11579166c None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:26.897518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 620/1245] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:26:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:26.904269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:27.007685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca538eb-dcbc-492b-9c64-ef9f3e09357d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:27.044895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdf61b-cb4c-4276-861c-f19e122e3efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:27.045637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf61b-cb4c-4276-861c-f19e122e3efe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.045924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf61b-cb4c-4276-861c-f19e122e3efe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.046255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf61b-cb4c-4276-861c-f19e122e3efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.047040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdf61b-cb4c-4276-861c-f19e122e3efe None admin] RBAC: Adding query filter params (role.id=d8b62a0f71124aa1bd3c62e2923db913, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=e79a5d5bbecb4835b3e8f4128b347aeb) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:27.047352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdf61b-cb4c-4276-861c-f19e122e3efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:27.048796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdf61b-cb4c-4276-861c-f19e122e3efe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:27.054907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 626/1246] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:26:26 2022] GET /identity/v3/role_assignments?user.id=e79a5d5bbecb4835b3e8f4128b347aeb&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=d8b62a0f71124aa1bd3c62e2923db913 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:29.473336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a340aa-2f85-4982-95cf-636d808ea491 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:29.473935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a340aa-2f85-4982-95cf-636d808ea491 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:29.473935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a340aa-2f85-4982-95cf-636d808ea491 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:29.475289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 621/1247] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:29.481755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ecf70-b6e8-4003-abe7-83508f6358e5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:29.482262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ecf70-b6e8-4003-abe7-83508f6358e5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:29.482405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ecf70-b6e8-4003-abe7-83508f6358e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:29.488010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:29.502521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-044ecf70-b6e8-4003-abe7-83508f6358e5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:29.503899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-044ecf70-b6e8-4003-abe7-83508f6358e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:29.578891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 627/1248] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:29.604305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a340aa-2f85-4982-95cf-636d808ea491 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:29.626126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:29.717003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a340aa-2f85-4982-95cf-636d808ea491 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:29.753597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725d488-c21c-4f1d-aeeb-06841adc0211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:29.754392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725d488-c21c-4f1d-aeeb-06841adc0211 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:29.754675 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725d488-c21c-4f1d-aeeb-06841adc0211 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:29.754952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725d488-c21c-4f1d-aeeb-06841adc0211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:29.766216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725d488-c21c-4f1d-aeeb-06841adc0211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-f725d488-c21c-4f1d-aeeb-06841adc0211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:29.776216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:29.777618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:29.778669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 622/1249] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:29.784039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ecf70-b6e8-4003-abe7-83508f6358e5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:29.886481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ecf70-b6e8-4003-abe7-83508f6358e5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:29.919088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:29.926815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:29.927647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:29.927953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:29.928247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:29.929088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:29.929442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:29.930984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:29.940526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 628/1250] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:26:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:29.946563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725d488-c21c-4f1d-aeeb-06841adc0211 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.034032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:30.061035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725d488-c21c-4f1d-aeeb-06841adc0211 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.098283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.098953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.099336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.099584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.112339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.113890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:30.132402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:30.133823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:30.135742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:30.135742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:30.135742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:30.135742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:30.138965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 623/1251] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:30.140262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.256230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2767-57e1-4ed7-bfa7-597e970d690d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.291173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.291852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.292163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.292465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.293224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:30.293536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.294914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:30.307654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 629/1252] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:30.313379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.415176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caccef-f28a-4aed-9270-e8f8fa36f2ad None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.443004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:30.452063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.452887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.453168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.453442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.461751 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.463799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:30.480081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:30.481794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:30.483001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 624/1253] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:30.489745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.549156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:30.601412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dce15-a04b-43a6-8cb0-9151d2640562 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.639658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.640329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.640610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.640922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.641759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:30.642067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.643529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:30.661084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 630/1254] 10.222.0.79 () {56 vars in 1143 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:30.666933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.771745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7eaca-9976-4ff7-aa9b-a4039aa73383 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.805439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d593f8-f2e4-4e11-81d3-823cff3ace68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.806594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d593f8-f2e4-4e11-81d3-823cff3ace68 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.806876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d593f8-f2e4-4e11-81d3-823cff3ace68 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.807151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d593f8-f2e4-4e11-81d3-823cff3ace68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.868233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:30.881612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d593f8-f2e4-4e11-81d3-823cff3ace68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.883095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d593f8-f2e4-4e11-81d3-823cff3ace68 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:30.987331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 625/1255] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:30.993708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.105989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1efd-24ed-4606-b6e3-5b9c2d4b4d4e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.122352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:31.148524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.149385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.150288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.150567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.162890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.164407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:31.183739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:31.184900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:31.185946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:31.185946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:31.185946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:31.185946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:31.185946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 631/1256] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:31.190737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d593f8-f2e4-4e11-81d3-823cff3ace68 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.282696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:31.297598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d593f8-f2e4-4e11-81d3-823cff3ace68 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.334369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.335047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.335330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.335608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.336612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:31.336960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.338354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.350559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 626/1257] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:31.356601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.459943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e725ceb-dfde-424b-a06f-56f88c7e50a0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.495405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.496211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.496496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.496776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.504234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.505731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:31.520097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:31.521206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:31.527145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 632/1258] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:31.529122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.628713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d810d8-78d8-4d32-920f-643845b182a9 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.662004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d57c-90a0-4c0a-818b-80b3a9194367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.662661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d57c-90a0-4c0a-818b-80b3a9194367 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.662942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d57c-90a0-4c0a-818b-80b3a9194367 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.663221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d57c-90a0-4c0a-818b-80b3a9194367 None admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.663994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d57c-90a0-4c0a-818b-80b3a9194367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:31.664300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d57c-90a0-4c0a-818b-80b3a9194367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.666283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d57c-90a0-4c0a-818b-80b3a9194367 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.678150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 627/1259] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:31.684863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.710613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:31.784477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea424cd-671d-4ea1-bcef-262e155784b5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.817052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9f825-09cc-4780-8ff4-89f8dca9069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.817688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f825-09cc-4780-8ff4-89f8dca9069a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.817968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f825-09cc-4780-8ff4-89f8dca9069a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.818241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9f825-09cc-4780-8ff4-89f8dca9069a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.819052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9f825-09cc-4780-8ff4-89f8dca9069a None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=e79a5d5bbecb4835b3e8f4128b347aeb) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:31.819366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9f825-09cc-4780-8ff4-89f8dca9069a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.820771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9f825-09cc-4780-8ff4-89f8dca9069a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.826053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 633/1260] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:26:31 2022] GET /identity/v3/role_assignments?user.id=e79a5d5bbecb4835b3e8f4128b347aeb&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:33.953691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6a721-6be8-4ee5-8978-499f291b4e6e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:33.954242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6a721-6be8-4ee5-8978-499f291b4e6e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:33.954242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6a721-6be8-4ee5-8978-499f291b4e6e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:33.955626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 628/1261] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:33.960673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620516a2-5a0e-468e-98ee-363123a6f130 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:33.961362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620516a2-5a0e-468e-98ee-363123a6f130 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:33.961526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620516a2-5a0e-468e-98ee-363123a6f130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:33.979190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-620516a2-5a0e-468e-98ee-363123a6f130 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:33.980368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-620516a2-5a0e-468e-98ee-363123a6f130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:34.044033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 634/1262] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:34.065985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6a721-6be8-4ee5-8978-499f291b4e6e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.077130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:34.171603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6a721-6be8-4ee5-8978-499f291b4e6e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.204562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70089-254c-4f49-8906-6162e4a46c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.205328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70089-254c-4f49-8906-6162e4a46c58 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.205613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70089-254c-4f49-8906-6162e4a46c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.205891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70089-254c-4f49-8906-6162e4a46c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.216516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a70089-254c-4f49-8906-6162e4a46c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-19a70089-254c-4f49-8906-6162e4a46c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:34.224158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:34.225277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:34.226324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 629/1263] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:34.231323 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620516a2-5a0e-468e-98ee-363123a6f130 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.248796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:34.327954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620516a2-5a0e-468e-98ee-363123a6f130 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.359997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.360653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.360964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.361243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.361976 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:34.362281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:34.363639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:34.371934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 635/1264] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:34.377706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70089-254c-4f49-8906-6162e4a46c58 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.442198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:34.476078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70089-254c-4f49-8906-6162e4a46c58 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.508242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.509637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.509927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.510207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.521113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:34.522556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:34.539121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:34.540184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:34.541322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:34.541322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:34.541322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:34.541322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:34.541322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 630/1265] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:34.545877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.624627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:34.643589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9223e-2617-4b6d-9b0a-7ad673049d3f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.675448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.676095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.676376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.676653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.677397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:34.677702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:34.679059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:34.690798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 636/1266] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:34.696412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.791604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00842f0-2389-4515-ad71-47ca40391400 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.810602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:34.824492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.825311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.825590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.825859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.833212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:34.834634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:34.848646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:34.849760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:34.851099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 631/1267] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:34.856093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.951569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569bb15-e24d-4e16-b2a4-0471da68f20e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.983990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.984644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.984956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.985234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.986057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:34.986365 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:34.987783 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:34.996611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:35.004809 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 637/1268] 10.222.0.79 () {56 vars in 1143 bytes} [Fri May 27 09:26:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:35.010276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:35.109863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea441b-d736-4cec-8c6e-901eda436d9f None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:35.144347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:35.145174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:35.145460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:35.145733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:35.156528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:35.157991 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:35.175078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:35.176144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:35.177277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:35.177277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:35.177277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:35.177277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:35.177277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 632/1269] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:35.181916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:35.277136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c7ba-01ef-4e58-b269-292db4ff9ff3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:35.309813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:35.310469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:35.310751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:35.311026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:35.311733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:35.312039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:35.313436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:35.324241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 638/1270] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:35.329720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:35.361390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:35.427483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb968b-3926-4e57-93e6-49b38b5d9b53 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:35.459853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:35.460631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:35.460944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:35.461476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:35.468574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:35.470029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:35.483900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:35.484946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:35.485895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 633/1271] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:26:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:35.490642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:35.546776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:35.589185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d387c84-d0cf-4fdd-99d0-e0fd3bac0b39 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:35.620681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f35faa-631d-4d00-9dae-cd8c372113de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:35.621305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f35faa-631d-4d00-9dae-cd8c372113de None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:35.621588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f35faa-631d-4d00-9dae-cd8c372113de None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:35.621862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f35faa-631d-4d00-9dae-cd8c372113de None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:35.622635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f35faa-631d-4d00-9dae-cd8c372113de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:35.622942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f35faa-631d-4d00-9dae-cd8c372113de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:35.624390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f35faa-631d-4d00-9dae-cd8c372113de None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:35.636741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 639/1272] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:26:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:35.642536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:35.729934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:35.738530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace50a-3f60-4e8c-84ac-ffcdb781e1c8 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:35.770902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d857f-238b-4079-bf62-8300e5a18134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:35.771769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d857f-238b-4079-bf62-8300e5a18134 None admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:35.772054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d857f-238b-4079-bf62-8300e5a18134 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:35.772332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d857f-238b-4079-bf62-8300e5a18134 None admin] PATH_INFO: `/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/e79a5d5bbecb4835b3e8f4128b347aeb/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:35.774285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d857f-238b-4079-bf62-8300e5a18134 None admin] RBAC: Authorizing `identity:create_grant(project_id=28d7e08d08ce4e51a0b752b6a286df86, user_id=e79a5d5bbecb4835b3e8f4128b347aeb, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:35.776235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d857f-238b-4079-bf62-8300e5a18134 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:35.789305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 634/1273] 10.222.0.79 () {58 vars in 1439 bytes} [Fri May 27 09:26:35 2022] PUT /identity/v3/projects/28d7e08d08ce4e51a0b752b6a286df86/users/e79a5d5bbecb4835b3e8f4128b347aeb/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:26:37.937204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db4078-1fbd-4021-9727-46eea43042aa None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.937764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db4078-1fbd-4021-9727-46eea43042aa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.937764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db4078-1fbd-4021-9727-46eea43042aa None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.939131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 640/1274] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:37.944152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb436-43f0-4535-8ee2-57e40c682860 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.944528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb436-43f0-4535-8ee2-57e40c682860 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.944704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cb436-43f0-4535-8ee2-57e40c682860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.961956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8d8cb436-43f0-4535-8ee2-57e40c682860 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:37.963132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8d8cb436-43f0-4535-8ee2-57e40c682860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:38.026639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 635/1275] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:38.049913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db4078-1fbd-4021-9727-46eea43042aa None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.151502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db4078-1fbd-4021-9727-46eea43042aa None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.169401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.185701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14a78-5853-4afb-a3a9-b8a781133eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.186479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14a78-5853-4afb-a3a9-b8a781133eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.186764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14a78-5853-4afb-a3a9-b8a781133eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.187042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14a78-5853-4afb-a3a9-b8a781133eb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.196965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14a78-5853-4afb-a3a9-b8a781133eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1ba14a78-5853-4afb-a3a9-b8a781133eb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:38.204469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:38.205605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:38.206637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 641/1276] 10.222.0.79 () {56 vars in 1096 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:38.212411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cb436-43f0-4535-8ee2-57e40c682860 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.289775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.309248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cb436-43f0-4535-8ee2-57e40c682860 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.342520 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.343180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.343463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.343740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.344480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:38.344788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.346174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.354665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 636/1277] 10.222.0.79 () {56 vars in 1099 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:38.360276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14a78-5853-4afb-a3a9-b8a781133eb6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.455659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14a78-5853-4afb-a3a9-b8a781133eb6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.487876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.488640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.488953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.489231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.499308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.500749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:38.517548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:38.518611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:38.519722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:38.519722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:38.519722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:38.519722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:38.519722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 642/1278] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:38.524219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.619335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f71e69-93ac-4fa5-ad3a-66f83514b0b4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.652235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.652915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.653199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.653479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.654201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:38.654512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.655863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.667343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 637/1279] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:38.672934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.704046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.773115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5fd3b-d4f1-4e0f-a324-6f784d5192ef None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.805020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.806294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.806575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.806848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.813921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.815346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:38.829958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:38.831067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:38.832064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 643/1280] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:38.837141 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.840808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.940120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43798c2-e70f-4caf-90d2-08da60301b72 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.972636 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.973331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.973614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.973890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.974714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:38.975021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.976424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.992545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 638/1281] 10.222.0.79 () {56 vars in 1143 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:38.998787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:39.086308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:39.095897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92101b3d-6af4-47a4-a4d0-5642ac05088d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:39.129520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014a20f-1419-48c2-a03f-a70c60a00672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:39.130169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014a20f-1419-48c2-a03f-a70c60a00672 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:39.130455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014a20f-1419-48c2-a03f-a70c60a00672 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:39.130736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014a20f-1419-48c2-a03f-a70c60a00672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:39.196097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014a20f-1419-48c2-a03f-a70c60a00672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:39.197572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014a20f-1419-48c2-a03f-a70c60a00672 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:39.281732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:39.292672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 644/1282] 10.222.0.79 () {58 vars in 1282 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:39.298470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:39.357738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:39.394658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de292385-09de-4a4f-a437-191c74482e08 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:39.426776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:39.427554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:39.427835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:39.428107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:39.438261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:39.439706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:39.457272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:39.458309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:39.459259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:39.459259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:39.459259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:39.459259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:39.459259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 639/1283] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:39.464280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014a20f-1419-48c2-a03f-a70c60a00672 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:39.558469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014a20f-1419-48c2-a03f-a70c60a00672 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:39.591602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:39.592243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:39.592520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:39.592791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:39.593563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:39.593869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:39.595234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:39.606477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 645/1284] 10.222.0.79 () {56 vars in 1109 bytes} [Fri May 27 09:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:39.612011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:39.706814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6df6-44f0-4a7d-9afa-9f447d70e6e4 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:39.720995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:39.741104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:39.741883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:39.742191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:39.742464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:39.748934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:39.750358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:39.763745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application with Lock( May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:39.764779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: ERROR keystone.server.flask.application May 27 09:26:39.765887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 640/1285] 10.222.0.79 () {56 vars in 1111 bytes} [Fri May 27 09:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:39.770814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:39.818694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:39.866939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b60a7-2036-4b8d-a746-d5bce3b193c1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:39.898588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c0b6b-e3b2-4d8e-8df6-1ae620089444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:39.899272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0b6b-e3b2-4d8e-8df6-1ae620089444 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:39.900055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0b6b-e3b2-4d8e-8df6-1ae620089444 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:39.900326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0b6b-e3b2-4d8e-8df6-1ae620089444 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:39.901119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c0b6b-e3b2-4d8e-8df6-1ae620089444 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:39.901422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c0b6b-e3b2-4d8e-8df6-1ae620089444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:39.902826 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c0b6b-e3b2-4d8e-8df6-1ae620089444 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:39.914136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 646/1286] 10.222.0.79 () {56 vars in 1148 bytes} [Fri May 27 09:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:39.919969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:40.014790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a0ea8-50b7-4bd8-b80e-0bf545c277de None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:40.046850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1cb5f-d3dc-4fe7-9788-83f46ad282d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:40.047487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1cb5f-d3dc-4fe7-9788-83f46ad282d7 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.047768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1cb5f-d3dc-4fe7-9788-83f46ad282d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.048044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1cb5f-d3dc-4fe7-9788-83f46ad282d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.048883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1cb5f-d3dc-4fe7-9788-83f46ad282d7 None admin] RBAC: Adding query filter params (role.id=fc9319be35744f288d5ef1dbfc8b5961, scope.project.id=28d7e08d08ce4e51a0b752b6a286df86, user.id=e79a5d5bbecb4835b3e8f4128b347aeb) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:40.049192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1cb5f-d3dc-4fe7-9788-83f46ad282d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:40.050595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1cb5f-d3dc-4fe7-9788-83f46ad282d7 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:40.056176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 641/1287] 10.222.0.79 () {56 vars in 1374 bytes} [Fri May 27 09:26:39 2022] GET /identity/v3/role_assignments?user.id=e79a5d5bbecb4835b3e8f4128b347aeb&scope.project.id=28d7e08d08ce4e51a0b752b6a286df86&role.id=fc9319be35744f288d5ef1dbfc8b5961 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:42.254282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9e4d-5ddd-4886-8ced-b6d442d1da65 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.254820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9e4d-5ddd-4886-8ced-b6d442d1da65 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.254820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9e4d-5ddd-4886-8ced-b6d442d1da65 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.256177 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 647/1288] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:42.262098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42995-4a46-420e-809a-09dbcd984af4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.262531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42995-4a46-420e-809a-09dbcd984af4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.262660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42995-4a46-420e-809a-09dbcd984af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.279675 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-16a42995-4a46-420e-809a-09dbcd984af4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:42.280873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-16a42995-4a46-420e-809a-09dbcd984af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:42.309539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:42.346892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 642/1289] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:42.368559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9e4d-5ddd-4886-8ced-b6d442d1da65 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.467543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9e4d-5ddd-4886-8ced-b6d442d1da65 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.477801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:42.500589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.501404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.501689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.501967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.502609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.503975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:42.516162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:42.517426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:42.518481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 648/1290] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:26:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:42.523241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a42995-4a46-420e-809a-09dbcd984af4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.617283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a42995-4a46-420e-809a-09dbcd984af4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.649842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518b4f5-cf96-4666-a21b-b4ad20a1efa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.650488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518b4f5-cf96-4666-a21b-b4ad20a1efa1 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.650767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518b4f5-cf96-4666-a21b-b4ad20a1efa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.651039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518b4f5-cf96-4666-a21b-b4ad20a1efa1 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.651731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518b4f5-cf96-4666-a21b-b4ad20a1efa1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:42.652035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518b4f5-cf96-4666-a21b-b4ad20a1efa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.653414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518b4f5-cf96-4666-a21b-b4ad20a1efa1 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.658042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 643/1291] 10.222.0.79 () {56 vars in 1116 bytes} [Fri May 27 09:26:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:42.663391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.760969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d56e2-c4e5-44c4-9c7f-deae87c12b15 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.792146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe83f9-201d-4f4a-8793-a81d13d16fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.792724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe83f9-201d-4f4a-8793-a81d13d16fdc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.793030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe83f9-201d-4f4a-8793-a81d13d16fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.793307 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe83f9-201d-4f4a-8793-a81d13d16fdc None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.793993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe83f9-201d-4f4a-8793-a81d13d16fdc None admin] RBAC: Adding query filter params (type=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:42.794295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe83f9-201d-4f4a-8793-a81d13d16fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.795639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe83f9-201d-4f4a-8793-a81d13d16fdc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.799927 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 649/1292] 10.222.0.79 () {56 vars in 1116 bytes} [Fri May 27 09:26:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:44.953884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502834fc-68ff-4111-9769-6d8e9892a694 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:44.954417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502834fc-68ff-4111-9769-6d8e9892a694 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:44.954417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502834fc-68ff-4111-9769-6d8e9892a694 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:44.955813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 644/1293] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:44.960965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90084e93-94b2-45b0-a711-360130a17923 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:44.962111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90084e93-94b2-45b0-a711-360130a17923 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:44.962290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90084e93-94b2-45b0-a711-360130a17923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:44.979203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-90084e93-94b2-45b0-a711-360130a17923 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:44.980373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-90084e93-94b2-45b0-a711-360130a17923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:45.008201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:45.044263 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 650/1294] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:45.066120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502834fc-68ff-4111-9769-6d8e9892a694 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:45.097735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:45.176505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502834fc-68ff-4111-9769-6d8e9892a694 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:45.209323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f24dd-85be-4656-972b-eb7364fd371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:45.209921 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f24dd-85be-4656-972b-eb7364fd371a None admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:45.210263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f24dd-85be-4656-972b-eb7364fd371a None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:45.210476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f24dd-85be-4656-972b-eb7364fd371a None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:45.211595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f24dd-85be-4656-972b-eb7364fd371a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:45.213481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f24dd-85be-4656-972b-eb7364fd371a None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:45.225838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 645/1295] 10.222.0.79 () {60 vars in 1141 bytes} [Fri May 27 09:26:45 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:47.508379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879787-e97d-429e-87fe-45ca6ae40a36 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.508918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879787-e97d-429e-87fe-45ca6ae40a36 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.509009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879787-e97d-429e-87fe-45ca6ae40a36 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.510358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 651/1296] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:47.515451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86cda9-af34-4f74-bebc-63d6b2132f15 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.515898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86cda9-af34-4f74-bebc-63d6b2132f15 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.515992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86cda9-af34-4f74-bebc-63d6b2132f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.532280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ba86cda9-af34-4f74-bebc-63d6b2132f15 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:47.533481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ba86cda9-af34-4f74-bebc-63d6b2132f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:47.604716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 646/1297] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:47.627553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54879787-e97d-429e-87fe-45ca6ae40a36 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.726910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54879787-e97d-429e-87fe-45ca6ae40a36 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.760644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.761454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.761743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.762025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.762674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.764053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:47.776105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:47.777354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:47.778389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 652/1298] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:47.783252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86cda9-af34-4f74-bebc-63d6b2132f15 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.801410 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:47.879318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86cda9-af34-4f74-bebc-63d6b2132f15 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.911418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b773-435f-463a-adad-989904323666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.912071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b773-435f-463a-adad-989904323666 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.912354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b773-435f-463a-adad-989904323666 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.912627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b773-435f-463a-adad-989904323666 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.913349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868b773-435f-463a-adad-989904323666 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:47.913653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868b773-435f-463a-adad-989904323666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.915630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868b773-435f-463a-adad-989904323666 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.920612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 647/1299] 10.222.0.79 () {56 vars in 1116 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:47.926405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.956311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:48.021519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75609b-567a-4ac8-afec-77a158325e28 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:48.053909 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5156054-16c4-4bdd-96fd-044b7e3d1697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:48.054578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156054-16c4-4bdd-96fd-044b7e3d1697 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:48.054855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156054-16c4-4bdd-96fd-044b7e3d1697 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:48.055152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156054-16c4-4bdd-96fd-044b7e3d1697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:48.055924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5156054-16c4-4bdd-96fd-044b7e3d1697 None admin] RBAC: Adding query filter params (interface=public, service_id=2bd8d624185a47828238559f2ac110c9, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:48.056228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5156054-16c4-4bdd-96fd-044b7e3d1697 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:48.057595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5156054-16c4-4bdd-96fd-044b7e3d1697 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:48.062419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 653/1300] 10.222.0.79 () {56 vars in 1251 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/endpoints?service_id=2bd8d624185a47828238559f2ac110c9&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:48.068114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b773-435f-463a-adad-989904323666 None admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:48.146705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:48.165146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b773-435f-463a-adad-989904323666 None admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:48.197599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a200268-6176-4a51-8d63-692851ff24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:48.198254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200268-6176-4a51-8d63-692851ff24a0 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:48.198539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200268-6176-4a51-8d63-692851ff24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:48.198819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200268-6176-4a51-8d63-692851ff24a0 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:48.199492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a200268-6176-4a51-8d63-692851ff24a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:48.200868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a200268-6176-4a51-8d63-692851ff24a0 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:48.207604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 648/1301] 10.222.0.79 () {56 vars in 1087 bytes} [Fri May 27 09:26:48 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:26:50.333046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aed00-c5f6-40cb-b64d-d1b90a15ddd7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:50.333456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aed00-c5f6-40cb-b64d-d1b90a15ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:50.333612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aed00-c5f6-40cb-b64d-d1b90a15ddd7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:50.334988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 654/1302] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:50.340313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac5739-7bf8-4f35-ad46-67c3cc506184 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:50.340695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac5739-7bf8-4f35-ad46-67c3cc506184 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:50.340897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac5739-7bf8-4f35-ad46-67c3cc506184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:50.357129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-deac5739-7bf8-4f35-ad46-67c3cc506184 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:50.358291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-deac5739-7bf8-4f35-ad46-67c3cc506184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:50.421156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 649/1303] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:26:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:50.443635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aed00-c5f6-40cb-b64d-d1b90a15ddd7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:50.535460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:50.543008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aed00-c5f6-40cb-b64d-d1b90a15ddd7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:50.575670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:50.576393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:50.576678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:50.577000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:50.577642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:50.579004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:50.590867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:50.592013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application May 27 09:26:50.593031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 655/1304] 10.222.0.79 () {56 vars in 1117 bytes} [Fri May 27 09:26:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:50.597989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac5739-7bf8-4f35-ad46-67c3cc506184 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:50.669983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:50.691856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac5739-7bf8-4f35-ad46-67c3cc506184 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:50.723764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dcfd3-98c1-488c-ad5a-7b3b78df8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:50.724427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dcfd3-98c1-488c-ad5a-7b3b78df8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:50.724712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dcfd3-98c1-488c-ad5a-7b3b78df8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:50.725018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dcfd3-98c1-488c-ad5a-7b3b78df8cf2 None admin] PATH_INFO: `/v3/services` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:50.725725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dcfd3-98c1-488c-ad5a-7b3b78df8cf2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:50.726036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dcfd3-98c1-488c-ad5a-7b3b78df8cf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:50.727910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dcfd3-98c1-488c-ad5a-7b3b78df8cf2 None admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:50.733056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 650/1305] 10.222.0.79 () {56 vars in 1116 bytes} [Fri May 27 09:26:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:50.738514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:50.835494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f17ac9-2d6e-4928-93cc-d75f0b63c804 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:50.868660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807789f7-347a-4d77-acc3-72d6e68f1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:50.869329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807789f7-347a-4d77-acc3-72d6e68f1e70 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:50.869621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807789f7-347a-4d77-acc3-72d6e68f1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:50.869905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807789f7-347a-4d77-acc3-72d6e68f1e70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:50.870653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807789f7-347a-4d77-acc3-72d6e68f1e70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:50.872011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807789f7-347a-4d77-acc3-72d6e68f1e70 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:50.889431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 656/1306] 10.222.0.79 () {60 vars in 1144 bytes} [Fri May 27 09:26:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:27:00.730114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=30 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:00.885184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:53.838754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0789ca-0235-4a2d-bb7c-f6cfbd3f8c0e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:53.839329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0789ca-0235-4a2d-bb7c-f6cfbd3f8c0e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:53.839329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0789ca-0235-4a2d-bb7c-f6cfbd3f8c0e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:53.846152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e3c4b-12dd-4ca9-bfdb-600138b1044e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:53.846581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e3c4b-12dd-4ca9-bfdb-600138b1044e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:53.846817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e3c4b-12dd-4ca9-bfdb-600138b1044e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:53.850230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 651/1307] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:27:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:53.921473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ca5e3c4b-12dd-4ca9-bfdb-600138b1044e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:53.922698 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ca5e3c4b-12dd-4ca9-bfdb-600138b1044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:54.053483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 657/1308] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:54.087570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688970-eb64-494c-85d3-cfa7c17c83fd None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:54.087865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688970-eb64-494c-85d3-cfa7c17c83fd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:54.088149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688970-eb64-494c-85d3-cfa7c17c83fd None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:54.089886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 652/1309] 10.222.0.79 () {54 vars in 964 bytes} [Fri May 27 09:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:54.106441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c19e47-b4b6-4653-81f6-20f43d195703 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:54.106441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c19e47-b4b6-4653-81f6-20f43d195703 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:54.106441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c19e47-b4b6-4653-81f6-20f43d195703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:54.185765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-35c19e47-b4b6-4653-81f6-20f43d195703 None None] MFA Rules not processed for user `ebee38389afb4270b18c6a14c7a4e302`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:54.186997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-35c19e47-b4b6-4653-81f6-20f43d195703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:54.215471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:54.336435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 658/1310] 10.222.0.79 () {58 vars in 1061 bytes} [Fri May 27 09:27:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:54.345562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688970-eb64-494c-85d3-cfa7c17c83fd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:54.347319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bd688970-eb64-494c-85d3-cfa7c17c83fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:54.477380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688970-eb64-494c-85d3-cfa7c17c83fd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:54.555333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d24ea-9d37-479f-8d69-cebdbe97afae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:54.555904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d24ea-9d37-479f-8d69-cebdbe97afae service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:54.556188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d24ea-9d37-479f-8d69-cebdbe97afae service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:54.556465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d24ea-9d37-479f-8d69-cebdbe97afae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:54.558248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a72d24ea-9d37-479f-8d69-cebdbe97afae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:54.616389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:54.676629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d24ea-9d37-479f-8d69-cebdbe97afae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:54.678216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d24ea-9d37-479f-8d69-cebdbe97afae service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:54.697739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 653/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:27:57.196995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103803-d2f0-4c0f-98a2-31153236b9bd None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:57.197472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103803-d2f0-4c0f-98a2-31153236b9bd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:57.197553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103803-d2f0-4c0f-98a2-31153236b9bd None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:57.199080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 659/1312] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:57.204139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0df8c-f363-4836-91f9-f4da2716ec8f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:57.204546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0df8c-f363-4836-91f9-f4da2716ec8f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:57.204707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0df8c-f363-4836-91f9-f4da2716ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:57.290161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d6e0df8c-f363-4836-91f9-f4da2716ec8f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:57.293581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d6e0df8c-f363-4836-91f9-f4da2716ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:57.398561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 654/1313] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:27:57.438161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103803-d2f0-4c0f-98a2-31153236b9bd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:57.439730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7a103803-d2f0-4c0f-98a2-31153236b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:57.546340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103803-d2f0-4c0f-98a2-31153236b9bd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:57.621583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:57.624485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527180ee-04d1-42bf-9e8c-f4cf4464f274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:57.625200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527180ee-04d1-42bf-9e8c-f4cf4464f274 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:57.625483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527180ee-04d1-42bf-9e8c-f4cf4464f274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:57.625839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527180ee-04d1-42bf-9e8c-f4cf4464f274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:57.628353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-527180ee-04d1-42bf-9e8c-f4cf4464f274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:57.742857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527180ee-04d1-42bf-9e8c-f4cf4464f274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:57.744304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527180ee-04d1-42bf-9e8c-f4cf4464f274 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:57.765525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 660/1314] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:00.340011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dad7b-9a8f-49fd-8b0b-5d0ba91f507d None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:00.340567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dad7b-9a8f-49fd-8b0b-5d0ba91f507d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:00.340567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dad7b-9a8f-49fd-8b0b-5d0ba91f507d None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:00.341984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 655/1315] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:28:00.347390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d5968-e3e3-41d7-8314-bb806aa4634b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:00.347812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d5968-e3e3-41d7-8314-bb806aa4634b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:00.347984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d5968-e3e3-41d7-8314-bb806aa4634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:00.411123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-871d5968-e3e3-41d7-8314-bb806aa4634b None None] MFA Rules not processed for user `412029d6037c41d8ab5af5921aa4da34`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:00.412343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-871d5968-e3e3-41d7-8314-bb806aa4634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:00.462862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:00.507070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 661/1316] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:00.561094 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985954-602a-4181-b990-5103223e8a68 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:00.561311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985954-602a-4181-b990-5103223e8a68 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:00.561633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60985954-602a-4181-b990-5103223e8a68 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:00.563028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 656/1317] 10.222.0.79 () {54 vars in 964 bytes} [Fri May 27 09:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:00.569762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be1144-7a7a-41ef-b1d9-78717d6443af None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:00.570052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be1144-7a7a-41ef-b1d9-78717d6443af None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:00.570331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be1144-7a7a-41ef-b1d9-78717d6443af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:00.642752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-77be1144-7a7a-41ef-b1d9-78717d6443af None None] MFA Rules not processed for user `ebee38389afb4270b18c6a14c7a4e302`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:00.643958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-77be1144-7a7a-41ef-b1d9-78717d6443af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:00.725527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 662/1318] 10.222.0.79 () {58 vars in 1061 bytes} [Fri May 27 09:28:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:00.734672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60985954-602a-4181-b990-5103223e8a68 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:00.736214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-60985954-602a-4181-b990-5103223e8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:00.746551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:00.840711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60985954-602a-4181-b990-5103223e8a68 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:00.911274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b558-f468-4e62-892a-23577594eb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:00.912433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b558-f468-4e62-892a-23577594eb94 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:00.912720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b558-f468-4e62-892a-23577594eb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:00.913031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b558-f468-4e62-892a-23577594eb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:00.914667 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9121b558-f468-4e62-892a-23577594eb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:00.976107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:01.022042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121b558-f468-4e62-892a-23577594eb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:01.023475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121b558-f468-4e62-892a-23577594eb94 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:01.041387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 657/1319] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:04.737005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81a9e-56d1-423a-9497-661563ecb81d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:04.737558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81a9e-56d1-423a-9497-661563ecb81d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:04.737558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81a9e-56d1-423a-9497-661563ecb81d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:04.738883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 663/1320] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:04.745012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1548f-d750-46f9-bfac-ad2a1de3693b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:04.745521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1548f-d750-46f9-bfac-ad2a1de3693b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:04.745638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1548f-d750-46f9-bfac-ad2a1de3693b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:04.810692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0db1548f-d750-46f9-bfac-ad2a1de3693b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:04.811924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0db1548f-d750-46f9-bfac-ad2a1de3693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:04.909182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 658/1321] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:04.948489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e81a9e-56d1-423a-9497-661563ecb81d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:04.950070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e9e81a9e-56d1-423a-9497-661563ecb81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:05.000684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:05.055211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e81a9e-56d1-423a-9497-661563ecb81d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:05.128297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65291f-416b-4f16-8992-e84a2a8ccb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:05.128986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65291f-416b-4f16-8992-e84a2a8ccb45 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:05.129270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65291f-416b-4f16-8992-e84a2a8ccb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:05.129546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65291f-416b-4f16-8992-e84a2a8ccb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:05.131761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6b65291f-416b-4f16-8992-e84a2a8ccb45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:05.227334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:05.241499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65291f-416b-4f16-8992-e84a2a8ccb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:05.242948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65291f-416b-4f16-8992-e84a2a8ccb45 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:05.261371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 664/1322] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:08.181375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499d9e-346d-455c-a581-671d55d3d5be None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:08.181915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499d9e-346d-455c-a581-671d55d3d5be None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:08.182035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499d9e-346d-455c-a581-671d55d3d5be None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:08.183386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 659/1323] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:08.189237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3c74-fdcf-425e-8fda-55a462b23299 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:08.189786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3c74-fdcf-425e-8fda-55a462b23299 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:08.189929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3c74-fdcf-425e-8fda-55a462b23299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:08.258979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f4ef3c74-fdcf-425e-8fda-55a462b23299 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:08.260194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f4ef3c74-fdcf-425e-8fda-55a462b23299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:08.366060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 665/1324] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:08.401837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55499d9e-346d-455c-a581-671d55d3d5be None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:08.403382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-55499d9e-346d-455c-a581-671d55d3d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:08.423314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:08.512609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55499d9e-346d-455c-a581-671d55d3d5be None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:08.588546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b62a9-f204-4fd0-b4af-4b0c59c7be36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:08.589240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b62a9-f204-4fd0-b4af-4b0c59c7be36 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:08.589524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b62a9-f204-4fd0-b4af-4b0c59c7be36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:08.589802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b62a9-f204-4fd0-b4af-4b0c59c7be36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:08.591483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-679b62a9-f204-4fd0-b4af-4b0c59c7be36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:08.664695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:08.702939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b62a9-f204-4fd0-b4af-4b0c59c7be36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:08.704392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b62a9-f204-4fd0-b4af-4b0c59c7be36 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:08.722913 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 660/1325] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:11.024703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de7ab-42f9-4f5e-9c96-ee10f381044c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:11.025271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de7ab-42f9-4f5e-9c96-ee10f381044c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:11.025388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de7ab-42f9-4f5e-9c96-ee10f381044c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:11.026823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 666/1326] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:11.032044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0f02b-8c65-4eed-b3d0-3b40afc74bd0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:11.032449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0f02b-8c65-4eed-b3d0-3b40afc74bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:11.032739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0f02b-8c65-4eed-b3d0-3b40afc74bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:11.101318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b9d0f02b-8c65-4eed-b3d0-3b40afc74bd0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:11.102580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b9d0f02b-8c65-4eed-b3d0-3b40afc74bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:11.201267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 661/1327] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:11.237998 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de7ab-42f9-4f5e-9c96-ee10f381044c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:11.239608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9a6de7ab-42f9-4f5e-9c96-ee10f381044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:11.301230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:11.347047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de7ab-42f9-4f5e-9c96-ee10f381044c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:11.427947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b075-506b-43e6-a087-abad490aadf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:11.428612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b075-506b-43e6-a087-abad490aadf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:11.428928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b075-506b-43e6-a087-abad490aadf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:11.429210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b075-506b-43e6-a087-abad490aadf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:11.430937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b16b075-506b-43e6-a087-abad490aadf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:11.544886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:11.547398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16b075-506b-43e6-a087-abad490aadf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:11.549134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16b075-506b-43e6-a087-abad490aadf1 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:11.569102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 667/1328] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:14.059511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bec55-cb45-4ded-a8b0-de7a8d49e8e5 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:14.060037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bec55-cb45-4ded-a8b0-de7a8d49e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:14.060226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bec55-cb45-4ded-a8b0-de7a8d49e8e5 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:14.061614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 662/1329] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:14.067000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f00a2-9110-4e17-a814-02784cefd91e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:14.067459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f00a2-9110-4e17-a814-02784cefd91e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:14.067554 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f00a2-9110-4e17-a814-02784cefd91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:14.131337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-266f00a2-9110-4e17-a814-02784cefd91e None None] MFA Rules not processed for user `412029d6037c41d8ab5af5921aa4da34`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:14.132455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-266f00a2-9110-4e17-a814-02784cefd91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:14.227447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 668/1330] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:14.263850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bec55-cb45-4ded-a8b0-de7a8d49e8e5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:14.265504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-026bec55-cb45-4ded-a8b0-de7a8d49e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:14.314431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:14.389987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bec55-cb45-4ded-a8b0-de7a8d49e8e5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:14.466847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65fff-f356-46dc-8e34-e8ef43d36f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:14.467502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65fff-f356-46dc-8e34-e8ef43d36f31 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:14.467783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65fff-f356-46dc-8e34-e8ef43d36f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:14.468058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65fff-f356-46dc-8e34-e8ef43d36f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:14.469739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f3d65fff-f356-46dc-8e34-e8ef43d36f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:14.550738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:14.584601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65fff-f356-46dc-8e34-e8ef43d36f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:14.586257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65fff-f356-46dc-8e34-e8ef43d36f31 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:14.604872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 663/1331] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:17.097156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832375-215b-4779-8752-40db3e38e424 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:17.097673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832375-215b-4779-8752-40db3e38e424 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:17.097766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832375-215b-4779-8752-40db3e38e424 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:17.099655 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 669/1332] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:28:17.105810 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9adb-0878-4cea-8af3-b39e55624bb0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:17.106323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9adb-0878-4cea-8af3-b39e55624bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:17.106442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9adb-0878-4cea-8af3-b39e55624bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:17.172806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0dda9adb-0878-4cea-8af3-b39e55624bb0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:17.174059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0dda9adb-0878-4cea-8af3-b39e55624bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:17.272933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 664/1333] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:17.308575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c832375-215b-4779-8752-40db3e38e424 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:17.310151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7c832375-215b-4779-8752-40db3e38e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:17.383609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:17.419138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c832375-215b-4779-8752-40db3e38e424 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:17.496179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e20dd7-955b-4508-a49f-00be02982aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:17.496860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e20dd7-955b-4508-a49f-00be02982aba service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:17.497139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e20dd7-955b-4508-a49f-00be02982aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:17.497417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e20dd7-955b-4508-a49f-00be02982aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:17.499042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-86e20dd7-955b-4508-a49f-00be02982aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:17.610803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e20dd7-955b-4508-a49f-00be02982aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:17.612274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e20dd7-955b-4508-a49f-00be02982aba service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:17.623090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:17.633971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 670/1334] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:19.885922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dabd63-bca8-4643-b35c-1eb3bb5d7fe5 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:19.886364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dabd63-bca8-4643-b35c-1eb3bb5d7fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:19.886521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dabd63-bca8-4643-b35c-1eb3bb5d7fe5 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:19.887865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 665/1335] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:19.893666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780640-9bd2-4a27-8244-a2d4ba9ea0bf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:19.894118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780640-9bd2-4a27-8244-a2d4ba9ea0bf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:19.894232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac780640-9bd2-4a27-8244-a2d4ba9ea0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:19.959619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ac780640-9bd2-4a27-8244-a2d4ba9ea0bf None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:19.961194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ac780640-9bd2-4a27-8244-a2d4ba9ea0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:20.058950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 671/1336] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:20.100773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dabd63-bca8-4643-b35c-1eb3bb5d7fe5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:20.102387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f7dabd63-bca8-4643-b35c-1eb3bb5d7fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:20.142982 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:20.205342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dabd63-bca8-4643-b35c-1eb3bb5d7fe5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:20.275970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559e28d-4e82-405c-97d8-608097e15165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:20.276611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559e28d-4e82-405c-97d8-608097e15165 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:20.276924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559e28d-4e82-405c-97d8-608097e15165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:20.277197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559e28d-4e82-405c-97d8-608097e15165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:20.278817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e559e28d-4e82-405c-97d8-608097e15165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:20.359470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:20.385937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559e28d-4e82-405c-97d8-608097e15165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:20.387378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559e28d-4e82-405c-97d8-608097e15165 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:20.405554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 666/1337] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:23.026136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede05dc-929b-4b14-843f-bc50eb149be3 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:23.026672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede05dc-929b-4b14-843f-bc50eb149be3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:23.026788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede05dc-929b-4b14-843f-bc50eb149be3 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:23.028069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 672/1338] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:23.033329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447d589-6937-4e5d-aaf4-e7e9542a2437 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:23.033703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447d589-6937-4e5d-aaf4-e7e9542a2437 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:23.033896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447d589-6937-4e5d-aaf4-e7e9542a2437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:23.098068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1447d589-6937-4e5d-aaf4-e7e9542a2437 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:23.099286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1447d589-6937-4e5d-aaf4-e7e9542a2437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:23.196653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 667/1339] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:23.231823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede05dc-929b-4b14-843f-bc50eb149be3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:23.233397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1ede05dc-929b-4b14-843f-bc50eb149be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:23.306902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:23.334575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede05dc-929b-4b14-843f-bc50eb149be3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:23.404770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090a969-7461-4112-b36b-84940ee28404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:23.405437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090a969-7461-4112-b36b-84940ee28404 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:23.405716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090a969-7461-4112-b36b-84940ee28404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:23.405986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090a969-7461-4112-b36b-84940ee28404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:23.407596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c090a969-7461-4112-b36b-84940ee28404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:23.512586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090a969-7461-4112-b36b-84940ee28404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:23.514066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090a969-7461-4112-b36b-84940ee28404 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:23.532984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 673/1340] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:27.734526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619f22-1c8f-4530-be6f-547f5ac70c40 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:27.735028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619f22-1c8f-4530-be6f-547f5ac70c40 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:27.735112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619f22-1c8f-4530-be6f-547f5ac70c40 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:27.736439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 668/1341] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:27.741763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e955-b2f3-4cd7-a909-c7491d9c86c6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:27.742238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e955-b2f3-4cd7-a909-c7491d9c86c6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:27.742340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e955-b2f3-4cd7-a909-c7491d9c86c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:27.748282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:27.813261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3c41e955-b2f3-4cd7-a909-c7491d9c86c6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:27.814380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3c41e955-b2f3-4cd7-a909-c7491d9c86c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:27.917694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 674/1342] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:27.955979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619f22-1c8f-4530-be6f-547f5ac70c40 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:27.958757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-09619f22-1c8f-4530-be6f-547f5ac70c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:28.008387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:28.053289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619f22-1c8f-4530-be6f-547f5ac70c40 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:28.056926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca866030-a4fa-4121-b51e-47689be3e230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:28.057571 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866030-a4fa-4121-b51e-47689be3e230 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:28.057851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866030-a4fa-4121-b51e-47689be3e230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:28.058122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866030-a4fa-4121-b51e-47689be3e230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:28.067570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca866030-a4fa-4121-b51e-47689be3e230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:28.068962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca866030-a4fa-4121-b51e-47689be3e230 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:28.078171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 669/1343] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:30.850584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa5b3f-def9-474b-8380-da828ee2e799 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:30.851116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa5b3f-def9-474b-8380-da828ee2e799 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:30.851339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa5b3f-def9-474b-8380-da828ee2e799 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:30.852726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 675/1344] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:30.858083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d21e-0ed0-474c-9d25-4eee247fc45f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:30.858510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d21e-0ed0-474c-9d25-4eee247fc45f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:30.858645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d21e-0ed0-474c-9d25-4eee247fc45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:30.886040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9be7d21e-0ed0-474c-9d25-4eee247fc45f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:30.887226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9be7d21e-0ed0-474c-9d25-4eee247fc45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:30.965169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 670/1345] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:31.000780 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa5b3f-def9-474b-8380-da828ee2e799 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:31.002506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b2aa5b3f-def9-474b-8380-da828ee2e799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:31.015735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa5b3f-def9-474b-8380-da828ee2e799 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:31.019216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f71572-870e-4348-8f1b-4652d7afa0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:31.020468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71572-870e-4348-8f1b-4652d7afa0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:31.020752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71572-870e-4348-8f1b-4652d7afa0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:31.021061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71572-870e-4348-8f1b-4652d7afa0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:31.029745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f71572-870e-4348-8f1b-4652d7afa0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:31.031170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f71572-870e-4348-8f1b-4652d7afa0e6 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:31.040446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 676/1346] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:35.416712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ba86e-cc8d-4533-8fcd-d1fb756288cd None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.417342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ba86e-cc8d-4533-8fcd-d1fb756288cd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.417342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ba86e-cc8d-4533-8fcd-d1fb756288cd None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.418696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 671/1347] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:35.423958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88565d4-eab8-45a6-8143-914bd4bdebdf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.424397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88565d4-eab8-45a6-8143-914bd4bdebdf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.424526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88565d4-eab8-45a6-8143-914bd4bdebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.442607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a88565d4-eab8-45a6-8143-914bd4bdebdf None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:35.443804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a88565d4-eab8-45a6-8143-914bd4bdebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:35.451832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 677/1348] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:35.489635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ba86e-cc8d-4533-8fcd-d1fb756288cd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:35.500227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ba86e-cc8d-4533-8fcd-d1fb756288cd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:35.503759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a317498-6774-4d1d-a4b5-8854414fe4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:35.504995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317498-6774-4d1d-a4b5-8854414fe4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.505340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317498-6774-4d1d-a4b5-8854414fe4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.505681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317498-6774-4d1d-a4b5-8854414fe4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.514647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a317498-6774-4d1d-a4b5-8854414fe4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:35.516153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a317498-6774-4d1d-a4b5-8854414fe4c9 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:35.526070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 672/1349] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:40.906076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552224-8c80-4195-a49a-26273877515d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:40.907040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552224-8c80-4195-a49a-26273877515d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:40.907507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552224-8c80-4195-a49a-26273877515d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:40.909360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 678/1350] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:40.918479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfcac2-c689-4e24-a350-e9c8685fd3f8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:40.919404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfcac2-c689-4e24-a350-e9c8685fd3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:40.919913 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfcac2-c689-4e24-a350-e9c8685fd3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:40.998068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-00cfcac2-c689-4e24-a350-e9c8685fd3f8 None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:40.999563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-00cfcac2-c689-4e24-a350-e9c8685fd3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:41.057281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:41.089906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 673/1351] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:28:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:45.345128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31be3d1-cc81-42c1-99ad-c248cd131c7c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:45.345990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31be3d1-cc81-42c1-99ad-c248cd131c7c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:45.346442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31be3d1-cc81-42c1-99ad-c248cd131c7c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:45.348019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 679/1352] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:45.353406 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17124e42-876d-42f2-a21b-8107310bca45 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:45.353875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17124e42-876d-42f2-a21b-8107310bca45 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:45.354275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17124e42-876d-42f2-a21b-8107310bca45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:45.373189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-17124e42-876d-42f2-a21b-8107310bca45 None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:45.374470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-17124e42-876d-42f2-a21b-8107310bca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:45.383896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 674/1353] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:28:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:45.437578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=72 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:46.829022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac52ec1-5405-4c9e-ab40-6e3d6ad9ab61 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:46.829660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac52ec1-5405-4c9e-ab40-6e3d6ad9ab61 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:46.829660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac52ec1-5405-4c9e-ab40-6e3d6ad9ab61 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:46.830930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 680/1354] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:46.836656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f3bd-71e6-4d8c-a325-baa9be41747a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:46.837118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f3bd-71e6-4d8c-a325-baa9be41747a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:46.837238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f3bd-71e6-4d8c-a325-baa9be41747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:46.856861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8ca7f3bd-71e6-4d8c-a325-baa9be41747a None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:46.858110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8ca7f3bd-71e6-4d8c-a325-baa9be41747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:46.866675 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 675/1355] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:28:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:50.843914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9319ad3-6840-4020-bfd2-2823dd54c3fa None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.844492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9319ad3-6840-4020-bfd2-2823dd54c3fa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.844492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9319ad3-6840-4020-bfd2-2823dd54c3fa None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:50.847375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 681/1356] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:50.851743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48c17-99fb-4540-a723-7c3d3dd0ca82 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.852155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48c17-99fb-4540-a723-7c3d3dd0ca82 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.852303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e48c17-99fb-4540-a723-7c3d3dd0ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:50.870787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-36e48c17-99fb-4540-a723-7c3d3dd0ca82 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:50.872093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-36e48c17-99fb-4540-a723-7c3d3dd0ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:50.882058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 676/1357] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:50.935239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662f6a-940a-4d89-96fd-9f27111c3bc8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.935713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662f6a-940a-4d89-96fd-9f27111c3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.936165 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662f6a-940a-4d89-96fd-9f27111c3bc8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:50.938002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 682/1358] 10.222.0.79 () {54 vars in 961 bytes} [Fri May 27 09:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:50.946118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14d78-04a7-4a25-ac7b-bf92971933bb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.947029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14d78-04a7-4a25-ac7b-bf92971933bb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.947626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14d78-04a7-4a25-ac7b-bf92971933bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:51.018071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-edb14d78-04a7-4a25-ac7b-bf92971933bb None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:51.021111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-edb14d78-04a7-4a25-ac7b-bf92971933bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:51.114353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 677/1359] 10.222.0.79 () {58 vars in 1058 bytes} [Fri May 27 09:28:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:51.127191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8662f6a-940a-4d89-96fd-9f27111c3bc8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:51.142849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8662f6a-940a-4d89-96fd-9f27111c3bc8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:51.149387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902514b5-0f45-47a9-b1bc-077fd114e1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:51.150210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902514b5-0f45-47a9-b1bc-077fd114e1ad service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:51.150667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902514b5-0f45-47a9-b1bc-077fd114e1ad service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:51.151210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902514b5-0f45-47a9-b1bc-077fd114e1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:51.160563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902514b5-0f45-47a9-b1bc-077fd114e1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:51.163132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902514b5-0f45-47a9-b1bc-077fd114e1ad service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:51.174373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 683/1360] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:28:53.592027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e93973-1cce-4226-93f1-7a743f130c52 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.592579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e93973-1cce-4226-93f1-7a743f130c52 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.592579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e93973-1cce-4226-93f1-7a743f130c52 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.593976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 678/1361] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:53.599588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a33c-3ca1-4af3-8cd6-70df808a736f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.600043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a33c-3ca1-4af3-8cd6-70df808a736f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.600191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a33c-3ca1-4af3-8cd6-70df808a736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.620171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2513a33c-3ca1-4af3-8cd6-70df808a736f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:53.621647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2513a33c-3ca1-4af3-8cd6-70df808a736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:53.631037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 684/1362] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:53.675631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e93973-1cce-4226-93f1-7a743f130c52 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:53.690219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e93973-1cce-4226-93f1-7a743f130c52 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:53.696086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a7976-5df8-4b94-8977-99518641a717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:53.696727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a7976-5df8-4b94-8977-99518641a717 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.697046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a7976-5df8-4b94-8977-99518641a717 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.697331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a7976-5df8-4b94-8977-99518641a717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.705822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a7976-5df8-4b94-8977-99518641a717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:53.707993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a7976-5df8-4b94-8977-99518641a717 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:53.718966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 679/1363] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:28:56.255589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25c38-5a36-4710-af59-1d08e7bb3f20 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:56.256094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25c38-5a36-4710-af59-1d08e7bb3f20 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:56.256219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe25c38-5a36-4710-af59-1d08e7bb3f20 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:56.257578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 685/1364] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:56.262710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d5e0-d976-43e2-9dde-c536b7f7d03f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:56.263108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d5e0-d976-43e2-9dde-c536b7f7d03f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:56.263269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d5e0-d976-43e2-9dde-c536b7f7d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:56.286497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-66e5d5e0-d976-43e2-9dde-c536b7f7d03f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:56.287926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-66e5d5e0-d976-43e2-9dde-c536b7f7d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:56.308137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 680/1365] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:56.356547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f1474-0467-43de-ab2f-290274b7cf55 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:56.356903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f1474-0467-43de-ab2f-290274b7cf55 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:56.357158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f1474-0467-43de-ab2f-290274b7cf55 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:56.358530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 686/1366] 10.222.0.79 () {54 vars in 961 bytes} [Fri May 27 09:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:56.364352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711d68-c032-4a60-bfc1-058e1c203084 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:56.364639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711d68-c032-4a60-bfc1-058e1c203084 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:56.364962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711d68-c032-4a60-bfc1-058e1c203084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:56.383611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-39711d68-c032-4a60-bfc1-058e1c203084 None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:56.384796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-39711d68-c032-4a60-bfc1-058e1c203084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:56.394038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 681/1367] 10.222.0.79 () {58 vars in 1058 bytes} [Fri May 27 09:28:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:28:56.401719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f1474-0467-43de-ab2f-290274b7cf55 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:56.416508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f1474-0467-43de-ab2f-290274b7cf55 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:56.421975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d920207-38ab-4b67-9242-018b6ceea561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:56.422608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d920207-38ab-4b67-9242-018b6ceea561 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:56.422893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d920207-38ab-4b67-9242-018b6ceea561 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:56.423170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d920207-38ab-4b67-9242-018b6ceea561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:56.431766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d920207-38ab-4b67-9242-018b6ceea561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:56.433398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d920207-38ab-4b67-9242-018b6ceea561 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:56.442662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 687/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:58.697911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b408f-7914-4604-a8f3-9aba217a50c0 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.698463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b408f-7914-4604-a8f3-9aba217a50c0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.698463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b408f-7914-4604-a8f3-9aba217a50c0 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.699758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 682/1369] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:58.705178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7818e-a9c0-46b0-a6d4-f93593815edc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.705586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7818e-a9c0-46b0-a6d4-f93593815edc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.705726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7818e-a9c0-46b0-a6d4-f93593815edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.724409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6bd7818e-a9c0-46b0-a6d4-f93593815edc None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:58.726094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6bd7818e-a9c0-46b0-a6d4-f93593815edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:58.733548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 688/1370] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:58.776714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b408f-7914-4604-a8f3-9aba217a50c0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:58.794648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b408f-7914-4604-a8f3-9aba217a50c0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:58.801434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf94a5-e68c-44cd-99b4-832fbb902f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:58.802112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf94a5-e68c-44cd-99b4-832fbb902f55 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.802393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf94a5-e68c-44cd-99b4-832fbb902f55 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.802668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf94a5-e68c-44cd-99b4-832fbb902f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.812001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf94a5-e68c-44cd-99b4-832fbb902f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:58.813654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf94a5-e68c-44cd-99b4-832fbb902f55 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:58.824507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 683/1371] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:28:58.987092 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3cfc1-04cd-40e7-8c74-032c629e44f4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.987582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3cfc1-04cd-40e7-8c74-032c629e44f4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.987970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3cfc1-04cd-40e7-8c74-032c629e44f4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.990269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 689/1372] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:28:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:58.996238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56998291-bf3e-4327-83c6-406610eabf1f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.996527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56998291-bf3e-4327-83c6-406610eabf1f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.997036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56998291-bf3e-4327-83c6-406610eabf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.016747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-56998291-bf3e-4327-83c6-406610eabf1f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:59.018038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-56998291-bf3e-4327-83c6-406610eabf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:59.028170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 684/1373] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:59.341841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4a4d-4b76-4cd4-835f-2a520c922762 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.342133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4a4d-4b76-4cd4-835f-2a520c922762 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.342815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4a4d-4b76-4cd4-835f-2a520c922762 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.343806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 690/1374] 10.222.0.79 () {54 vars in 963 bytes} [Fri May 27 09:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:59.350723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bd12b-c3fe-4736-a108-b52e24095d5b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.351017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bd12b-c3fe-4736-a108-b52e24095d5b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.351299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bd12b-c3fe-4736-a108-b52e24095d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.360805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:59.405670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-156bd12b-c3fe-4736-a108-b52e24095d5b None None] MFA Rules not processed for user `fe6a8bf853cd4b60916375d9ebbd468f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:59.406869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-156bd12b-c3fe-4736-a108-b52e24095d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:59.469870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 685/1375] 10.222.0.79 () {58 vars in 1060 bytes} [Fri May 27 09:28:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:28:59.477274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4a4d-4b76-4cd4-835f-2a520c922762 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:59.489192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4a4d-4b76-4cd4-835f-2a520c922762 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:59.492885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa31efb-9702-47fe-8b07-4882b37ce8d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:59.493901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa31efb-9702-47fe-8b07-4882b37ce8d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.494430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa31efb-9702-47fe-8b07-4882b37ce8d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.494813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa31efb-9702-47fe-8b07-4882b37ce8d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.506387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa31efb-9702-47fe-8b07-4882b37ce8d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:59.508183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa31efb-9702-47fe-8b07-4882b37ce8d1 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:59.519887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 691/1376] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:01.054326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d91c18-fd9d-40ad-aec6-cdb05c5f4219 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:01.054884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d91c18-fd9d-40ad-aec6-cdb05c5f4219 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:01.054884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d91c18-fd9d-40ad-aec6-cdb05c5f4219 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:01.056291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 686/1377] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:01.062359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453d35-bcfb-45d5-a1e3-861f26947648 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:01.062916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453d35-bcfb-45d5-a1e3-861f26947648 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:01.062916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453d35-bcfb-45d5-a1e3-861f26947648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:01.082377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8c453d35-bcfb-45d5-a1e3-861f26947648 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:01.083603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8c453d35-bcfb-45d5-a1e3-861f26947648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:01.092108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 692/1378] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:01.137553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d91c18-fd9d-40ad-aec6-cdb05c5f4219 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:01.152958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d91c18-fd9d-40ad-aec6-cdb05c5f4219 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:01.158609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812334fc-bb87-44a3-8fb5-e58ee5a4109b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:01.159281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812334fc-bb87-44a3-8fb5-e58ee5a4109b service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:01.159567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812334fc-bb87-44a3-8fb5-e58ee5a4109b service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:01.159847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812334fc-bb87-44a3-8fb5-e58ee5a4109b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:01.169101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812334fc-bb87-44a3-8fb5-e58ee5a4109b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:01.170739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812334fc-bb87-44a3-8fb5-e58ee5a4109b service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:01.181696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 687/1379] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:03.445779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b8d1-af65-4a2b-a659-a042975966ba None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.446691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b8d1-af65-4a2b-a659-a042975966ba None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.446984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b8d1-af65-4a2b-a659-a042975966ba None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.448757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 693/1380] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:03.454524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440224-5e19-4902-b937-8229372a86c5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.454986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440224-5e19-4902-b937-8229372a86c5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.455188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440224-5e19-4902-b937-8229372a86c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.473891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-05440224-5e19-4902-b937-8229372a86c5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:03.475083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-05440224-5e19-4902-b937-8229372a86c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:03.483213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 688/1381] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:03.527633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b8d1-af65-4a2b-a659-a042975966ba None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:03.543941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b8d1-af65-4a2b-a659-a042975966ba None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:03.549425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35014129-0244-4512-a021-6233b199d013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:03.550067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014129-0244-4512-a021-6233b199d013 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.550348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014129-0244-4512-a021-6233b199d013 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.550850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014129-0244-4512-a021-6233b199d013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.559637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35014129-0244-4512-a021-6233b199d013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:03.561260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35014129-0244-4512-a021-6233b199d013 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:03.571688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 694/1382] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:05.811478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe849-0131-446e-97b7-cc14248af19d None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:05.811993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe849-0131-446e-97b7-cc14248af19d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:05.811993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fe849-0131-446e-97b7-cc14248af19d None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:05.813519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 689/1383] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:05.818675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeaa04-e945-47dd-a3f3-993ad4bea82e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:05.819112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeaa04-e945-47dd-a3f3-993ad4bea82e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:05.819219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeaa04-e945-47dd-a3f3-993ad4bea82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:05.838096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1cfeaa04-e945-47dd-a3f3-993ad4bea82e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:05.839296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1cfeaa04-e945-47dd-a3f3-993ad4bea82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:05.848913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 695/1384] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:05.889405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fe849-0131-446e-97b7-cc14248af19d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:05.905037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fe849-0131-446e-97b7-cc14248af19d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:05.911613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec7d5b-bc0a-477d-b4c0-f81f09a0ae2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:05.912432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec7d5b-bc0a-477d-b4c0-f81f09a0ae2b service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:05.912902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec7d5b-bc0a-477d-b4c0-f81f09a0ae2b service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:05.913360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec7d5b-bc0a-477d-b4c0-f81f09a0ae2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:05.922583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec7d5b-bc0a-477d-b4c0-f81f09a0ae2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:05.924551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec7d5b-bc0a-477d-b4c0-f81f09a0ae2b service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:05.936010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 690/1385] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:08.139478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b521d-a1ba-4cf3-b6de-da20a860fe07 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:08.140170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b521d-a1ba-4cf3-b6de-da20a860fe07 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:08.140170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b521d-a1ba-4cf3-b6de-da20a860fe07 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:08.141574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 696/1386] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:08.146734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea9765-b068-44c7-8b83-4f37f3abe017 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:08.147206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea9765-b068-44c7-8b83-4f37f3abe017 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:08.147357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea9765-b068-44c7-8b83-4f37f3abe017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:08.168299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-feea9765-b068-44c7-8b83-4f37f3abe017 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:08.169822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-feea9765-b068-44c7-8b83-4f37f3abe017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:08.180458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 691/1387] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:08.225106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b521d-a1ba-4cf3-b6de-da20a860fe07 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:08.239597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b521d-a1ba-4cf3-b6de-da20a860fe07 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:08.245008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe56d-3893-4230-9709-e5f4bdc3f580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:08.245644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe56d-3893-4230-9709-e5f4bdc3f580 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:08.245924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe56d-3893-4230-9709-e5f4bdc3f580 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:08.246201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe56d-3893-4230-9709-e5f4bdc3f580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:08.254951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebe56d-3893-4230-9709-e5f4bdc3f580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:08.256529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebe56d-3893-4230-9709-e5f4bdc3f580 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:08.265908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 697/1388] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:10.558489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c672f-5909-4385-8b5e-6a134d997a47 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:10.559057 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c672f-5909-4385-8b5e-6a134d997a47 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:10.559158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c672f-5909-4385-8b5e-6a134d997a47 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:10.560546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 692/1389] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:10.566767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2b598-d7e2-40c0-96da-f89b7dbeea40 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:10.567192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2b598-d7e2-40c0-96da-f89b7dbeea40 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:10.567331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2b598-d7e2-40c0-96da-f89b7dbeea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:10.585305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9cc2b598-d7e2-40c0-96da-f89b7dbeea40 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:10.586757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9cc2b598-d7e2-40c0-96da-f89b7dbeea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:10.594688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 698/1390] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:10.646482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c672f-5909-4385-8b5e-6a134d997a47 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:10.663212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c672f-5909-4385-8b5e-6a134d997a47 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:10.677167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c891d-744e-47e1-86b2-5384c40028f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:10.677167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c891d-744e-47e1-86b2-5384c40028f8 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:10.677167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c891d-744e-47e1-86b2-5384c40028f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:10.677167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c891d-744e-47e1-86b2-5384c40028f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:10.685177 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c891d-744e-47e1-86b2-5384c40028f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:10.687441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c891d-744e-47e1-86b2-5384c40028f8 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:10.699709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 693/1391] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:13.015467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241e02-0970-498b-a8c2-0642cf21578d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:13.016178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241e02-0970-498b-a8c2-0642cf21578d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:13.016178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241e02-0970-498b-a8c2-0642cf21578d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:13.017436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 699/1392] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:13.023181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b4e1-e58c-4f0d-bb92-d4d218682fb4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:13.023650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b4e1-e58c-4f0d-bb92-d4d218682fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:13.023946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b4e1-e58c-4f0d-bb92-d4d218682fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:13.046267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-57f9b4e1-e58c-4f0d-bb92-d4d218682fb4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:13.047554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-57f9b4e1-e58c-4f0d-bb92-d4d218682fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:13.056437 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 694/1393] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:13.111881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1241e02-0970-498b-a8c2-0642cf21578d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:13.127724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1241e02-0970-498b-a8c2-0642cf21578d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:13.133223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a202-4d43-4547-bb8f-fe62f425ce46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:13.133848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a202-4d43-4547-bb8f-fe62f425ce46 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:13.134134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a202-4d43-4547-bb8f-fe62f425ce46 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:13.134416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a202-4d43-4547-bb8f-fe62f425ce46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:13.142835 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a202-4d43-4547-bb8f-fe62f425ce46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:13.144462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a202-4d43-4547-bb8f-fe62f425ce46 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:13.154081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 700/1394] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:29:15.348399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a508-fc5a-4454-a1d6-091e7b30ae13 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:15.348977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a508-fc5a-4454-a1d6-091e7b30ae13 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:15.349077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a508-fc5a-4454-a1d6-091e7b30ae13 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:15.350461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 695/1395] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:15.355711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ecbe4-9ca6-4841-801b-29b62fbbca3b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:15.356147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ecbe4-9ca6-4841-801b-29b62fbbca3b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:15.356259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ecbe4-9ca6-4841-801b-29b62fbbca3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:15.374402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-029ecbe4-9ca6-4841-801b-29b62fbbca3b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:15.375596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-029ecbe4-9ca6-4841-801b-29b62fbbca3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:15.383685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 701/1396] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:15.384289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917b92-6fdf-4ff4-a53a-8f427623969f None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:15.384576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917b92-6fdf-4ff4-a53a-8f427623969f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:15.384877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917b92-6fdf-4ff4-a53a-8f427623969f None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:15.386355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 696/1397] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:29:15.391376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed77a-42c5-46f6-aef8-11cb7d5759ea None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:15.391663 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed77a-42c5-46f6-aef8-11cb7d5759ea None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:15.391941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed77a-42c5-46f6-aef8-11cb7d5759ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:15.409168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c32ed77a-42c5-46f6-aef8-11cb7d5759ea None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:15.410920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c32ed77a-42c5-46f6-aef8-11cb7d5759ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:15.419187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 702/1398] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:15.439241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94411-e74a-4fe6-b473-aaa25bc80eda None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:15.439600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94411-e74a-4fe6-b473-aaa25bc80eda None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:15.439960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94411-e74a-4fe6-b473-aaa25bc80eda None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:15.441467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 697/1399] 10.222.0.79 () {54 vars in 962 bytes} [Fri May 27 09:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:15.447000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59661fa8-1062-4039-b126-d0e53899afb6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:15.447000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59661fa8-1062-4039-b126-d0e53899afb6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:15.447000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59661fa8-1062-4039-b126-d0e53899afb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:15.452889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=58 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:15.463893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa94411-e74a-4fe6-b473-aaa25bc80eda None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:15.478461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa94411-e74a-4fe6-b473-aaa25bc80eda None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:15.484022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623977bf-4b94-4b67-a68b-13a254169897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:15.484658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623977bf-4b94-4b67-a68b-13a254169897 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:15.484969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623977bf-4b94-4b67-a68b-13a254169897 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:15.485245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623977bf-4b94-4b67-a68b-13a254169897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:15.493956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623977bf-4b94-4b67-a68b-13a254169897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:15.495532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623977bf-4b94-4b67-a68b-13a254169897 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:15.499248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-59661fa8-1062-4039-b126-d0e53899afb6 None None] MFA Rules not processed for user `2b11f7990b364f5281def98b941e1e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:15.500448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-59661fa8-1062-4039-b126-d0e53899afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:15.504767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 698/1400] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:15.562006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 703/1401] 10.222.0.79 () {58 vars in 1059 bytes} [Fri May 27 09:29:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:15.570696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623977bf-4b94-4b67-a68b-13a254169897 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:15.580659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623977bf-4b94-4b67-a68b-13a254169897 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:15.585280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9f302-a401-4dc6-8885-4fe70a249770 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:15.585957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9f302-a401-4dc6-8885-4fe70a249770 service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:15.586239 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9f302-a401-4dc6-8885-4fe70a249770 service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:15.586777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9f302-a401-4dc6-8885-4fe70a249770 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:15.597191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9f302-a401-4dc6-8885-4fe70a249770 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:15.599289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9f302-a401-4dc6-8885-4fe70a249770 service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:15.610406 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 699/1402] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:16.145854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95efbb-d77a-468d-af94-541eacbd9711 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:16.146151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95efbb-d77a-468d-af94-541eacbd9711 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:16.146463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95efbb-d77a-468d-af94-541eacbd9711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:16.193687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4f95efbb-d77a-468d-af94-541eacbd9711 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:16.194880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4f95efbb-d77a-468d-af94-541eacbd9711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:16.258129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 704/1403] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:29:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:16.304505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6719d-75d3-4292-8ede-a7a5c0e42a18 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:16.304895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6719d-75d3-4292-8ede-a7a5c0e42a18 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:16.305280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6719d-75d3-4292-8ede-a7a5c0e42a18 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:16.306759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 700/1404] 10.222.0.79 () {54 vars in 942 bytes} [Fri May 27 09:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:16.312941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff346-0f23-4636-9060-a818b4f8ea0e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:16.313305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff346-0f23-4636-9060-a818b4f8ea0e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:16.313655 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff346-0f23-4636-9060-a818b4f8ea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:16.361808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ebcff346-0f23-4636-9060-a818b4f8ea0e None None] MFA Rules not processed for user `113f9a9f11014b9ba3efe6781615d68b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:16.363043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ebcff346-0f23-4636-9060-a818b4f8ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:16.383170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:16.434121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 705/1405] 10.222.0.79 () {58 vars in 1039 bytes} [Fri May 27 09:29:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:16.443390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6719d-75d3-4292-8ede-a7a5c0e42a18 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:16.456387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6719d-75d3-4292-8ede-a7a5c0e42a18 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:16.462034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7919dc-cbff-4d86-9f2a-4eb0e510d7aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:16.462661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7919dc-cbff-4d86-9f2a-4eb0e510d7aa service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:16.462943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7919dc-cbff-4d86-9f2a-4eb0e510d7aa service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:16.463221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7919dc-cbff-4d86-9f2a-4eb0e510d7aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:16.471002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7919dc-cbff-4d86-9f2a-4eb0e510d7aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:16.473153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7919dc-cbff-4d86-9f2a-4eb0e510d7aa service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:16.481193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 701/1406] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:29:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:29:17.740867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875e0ad-2821-4f1f-b0fb-6fac921a5b1e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:17.741326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875e0ad-2821-4f1f-b0fb-6fac921a5b1e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:17.741514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875e0ad-2821-4f1f-b0fb-6fac921a5b1e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:17.742870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 706/1407] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:17.748221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d090-ee46-4b61-ba57-caf3bb817b3f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:17.749012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d090-ee46-4b61-ba57-caf3bb817b3f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:17.749296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d090-ee46-4b61-ba57-caf3bb817b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:17.767993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c987d090-ee46-4b61-ba57-caf3bb817b3f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:17.769771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c987d090-ee46-4b61-ba57-caf3bb817b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:17.778002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 702/1408] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:17.822678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875e0ad-2821-4f1f-b0fb-6fac921a5b1e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:17.838421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875e0ad-2821-4f1f-b0fb-6fac921a5b1e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:17.846789 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d30ce-a7f5-43d3-ac6a-685c2770457b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:17.848014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d30ce-a7f5-43d3-ac6a-685c2770457b service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:17.848297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d30ce-a7f5-43d3-ac6a-685c2770457b service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:17.848571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d30ce-a7f5-43d3-ac6a-685c2770457b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:17.857795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d30ce-a7f5-43d3-ac6a-685c2770457b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:17.859382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d30ce-a7f5-43d3-ac6a-685c2770457b service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:17.869863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 707/1409] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:27.761635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:27.865379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=27 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:39.700017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f591-2b40-49e8-8321-4b27c5595db0 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:39.700662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f591-2b40-49e8-8321-4b27c5595db0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:39.700662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f591-2b40-49e8-8321-4b27c5595db0 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:39.701912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 703/1410] 10.222.0.79 () {54 vars in 918 bytes} [Fri May 27 09:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:39.707016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28168f81-bb1a-447b-b216-af44139de0b0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:39.707484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28168f81-bb1a-447b-b216-af44139de0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:39.707596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28168f81-bb1a-447b-b216-af44139de0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:39.725207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-28168f81-bb1a-447b-b216-af44139de0b0 None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:39.726382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-28168f81-bb1a-447b-b216-af44139de0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:39.734733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 708/1411] 10.222.0.79 () {58 vars in 1015 bytes} [Fri May 27 09:29:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:39.749365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ad91-2902-47ae-874e-72c9c76c6001 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:39.749661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ad91-2902-47ae-874e-72c9c76c6001 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:39.749949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ad91-2902-47ae-874e-72c9c76c6001 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:39.751332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 704/1412] 10.222.0.79 () {54 vars in 918 bytes} [Fri May 27 09:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:39.756306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edabfc-ab79-4e71-9eb3-dc457122395c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:39.756593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edabfc-ab79-4e71-9eb3-dc457122395c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:39.756898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edabfc-ab79-4e71-9eb3-dc457122395c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:39.774136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-19edabfc-ab79-4e71-9eb3-dc457122395c None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:39.775292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-19edabfc-ab79-4e71-9eb3-dc457122395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:39.784181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 709/1413] 10.222.0.79 () {58 vars in 1015 bytes} [Fri May 27 09:29:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:42.416976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7e647-1a0d-4557-8175-0528a34abd57 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:42.417572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7e647-1a0d-4557-8175-0528a34abd57 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:42.417572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7e647-1a0d-4557-8175-0528a34abd57 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:42.418901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:42.424006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca79034-db29-4006-862c-14d87ae99eb1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:42.424410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca79034-db29-4006-862c-14d87ae99eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:42.424563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca79034-db29-4006-862c-14d87ae99eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:42.442272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6ca79034-db29-4006-862c-14d87ae99eb1 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:42.443446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6ca79034-db29-4006-862c-14d87ae99eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:42.451068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:42.493549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7e647-1a0d-4557-8175-0528a34abd57 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:42.510198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7e647-1a0d-4557-8175-0528a34abd57 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:42.515682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c25c5c-f7e2-4cde-a1cc-9a7b75647052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:42.516317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25c5c-f7e2-4cde-a1cc-9a7b75647052 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:42.516597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25c5c-f7e2-4cde-a1cc-9a7b75647052 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:42.516903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25c5c-f7e2-4cde-a1cc-9a7b75647052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:42.525200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c25c5c-f7e2-4cde-a1cc-9a7b75647052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:42.526768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c25c5c-f7e2-4cde-a1cc-9a7b75647052 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:42.535924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 706/1416] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:43.500572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270831-82bb-4782-af43-6d0bbae3083e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:43.501167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270831-82bb-4782-af43-6d0bbae3083e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:43.501167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270831-82bb-4782-af43-6d0bbae3083e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:43.502549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:43.507456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b87cb-62d2-4f32-9f78-8ac2a73e6740 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:43.507916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b87cb-62d2-4f32-9f78-8ac2a73e6740 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:43.508025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b87cb-62d2-4f32-9f78-8ac2a73e6740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:43.526121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0c8b87cb-62d2-4f32-9f78-8ac2a73e6740 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:43.527312 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0c8b87cb-62d2-4f32-9f78-8ac2a73e6740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:43.535677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:43.685926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31270831-82bb-4782-af43-6d0bbae3083e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:43.700599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31270831-82bb-4782-af43-6d0bbae3083e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:43.705968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f537b-b176-4925-8e6e-cb54fee35c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:43.707198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f537b-b176-4925-8e6e-cb54fee35c1a service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:43.707480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f537b-b176-4925-8e6e-cb54fee35c1a service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:43.707757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f537b-b176-4925-8e6e-cb54fee35c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:43.716007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f537b-b176-4925-8e6e-cb54fee35c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:43.717641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f537b-b176-4925-8e6e-cb54fee35c1a service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:43.726779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 712/1419] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:44.645337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ae13-50a1-4dee-9cd3-efb577dbf117 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:44.645871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ae13-50a1-4dee-9cd3-efb577dbf117 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:44.645871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ae13-50a1-4dee-9cd3-efb577dbf117 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:44.647190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:44.652026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440fdd-b693-40b9-b5c3-a15812eafef6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:44.652442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440fdd-b693-40b9-b5c3-a15812eafef6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:44.652593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440fdd-b693-40b9-b5c3-a15812eafef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:44.671911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8e440fdd-b693-40b9-b5c3-a15812eafef6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:44.673176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8e440fdd-b693-40b9-b5c3-a15812eafef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:44.681713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:44.829421 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ae13-50a1-4dee-9cd3-efb577dbf117 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:44.844391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ae13-50a1-4dee-9cd3-efb577dbf117 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:44.850351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e399c-6909-4776-931d-f841feccb858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:44.850986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e399c-6909-4776-931d-f841feccb858 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:44.851274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e399c-6909-4776-931d-f841feccb858 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:44.851561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e399c-6909-4776-931d-f841feccb858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:44.859560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e399c-6909-4776-931d-f841feccb858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:44.861173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e399c-6909-4776-931d-f841feccb858 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:44.870492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 709/1422] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:45.767952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae98f-925c-4642-ba5e-a5f8f68ebfea None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:45.768385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae98f-925c-4642-ba5e-a5f8f68ebfea None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:45.768506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae98f-925c-4642-ba5e-a5f8f68ebfea None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:45.769957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:45.774944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce537-f4df-4eba-b285-51b035d3fa8b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:45.775400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce537-f4df-4eba-b285-51b035d3fa8b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:45.775498 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce537-f4df-4eba-b285-51b035d3fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:45.793596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b02ce537-f4df-4eba-b285-51b035d3fa8b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:45.794794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b02ce537-f4df-4eba-b285-51b035d3fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:45.803023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:45.949142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aae98f-925c-4642-ba5e-a5f8f68ebfea None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:45.963432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aae98f-925c-4642-ba5e-a5f8f68ebfea None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:45.968706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274d819-de1b-4e4c-9880-8744dea985c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:45.969368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274d819-de1b-4e4c-9880-8744dea985c8 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:45.969652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274d819-de1b-4e4c-9880-8744dea985c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:45.969930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274d819-de1b-4e4c-9880-8744dea985c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:45.978345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274d819-de1b-4e4c-9880-8744dea985c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:45.979961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274d819-de1b-4e4c-9880-8744dea985c8 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:45.989770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 715/1425] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:46.884444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe59c6-b1ef-45e5-a957-abbaf8d959c9 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:46.885016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe59c6-b1ef-45e5-a957-abbaf8d959c9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:46.885016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe59c6-b1ef-45e5-a957-abbaf8d959c9 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:46.886404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:46.891540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfa5c5-c4a7-4c16-bde9-fc07657bb374 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:46.891948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfa5c5-c4a7-4c16-bde9-fc07657bb374 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:46.892140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfa5c5-c4a7-4c16-bde9-fc07657bb374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:46.910410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-16dfa5c5-c4a7-4c16-bde9-fc07657bb374 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:46.911594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-16dfa5c5-c4a7-4c16-bde9-fc07657bb374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:46.919317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:47.068095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe59c6-b1ef-45e5-a957-abbaf8d959c9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:47.083602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe59c6-b1ef-45e5-a957-abbaf8d959c9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:47.089228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2636e-ae70-401b-9508-49318d464958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:47.089866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2636e-ae70-401b-9508-49318d464958 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:47.090151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2636e-ae70-401b-9508-49318d464958 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:47.090430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2636e-ae70-401b-9508-49318d464958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:47.099102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2636e-ae70-401b-9508-49318d464958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:47.100696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2636e-ae70-401b-9508-49318d464958 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:47.110162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 712/1428] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:47.956275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930c34-4b9d-4a81-a02d-c78fce4c0801 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:47.957337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930c34-4b9d-4a81-a02d-c78fce4c0801 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:47.957337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930c34-4b9d-4a81-a02d-c78fce4c0801 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:47.958740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:47.963838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745039-aa72-4254-b139-d5c9c7bbcc01 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:47.964271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745039-aa72-4254-b139-d5c9c7bbcc01 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:47.964472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745039-aa72-4254-b139-d5c9c7bbcc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:47.982662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-29745039-aa72-4254-b139-d5c9c7bbcc01 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:47.983866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-29745039-aa72-4254-b139-d5c9c7bbcc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:47.991668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:48.141256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc930c34-4b9d-4a81-a02d-c78fce4c0801 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:48.156735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc930c34-4b9d-4a81-a02d-c78fce4c0801 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:48.162242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d8e48-f83c-4198-a7b2-134ab0bbc5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:48.162880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8e48-f83c-4198-a7b2-134ab0bbc5a5 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:48.163160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8e48-f83c-4198-a7b2-134ab0bbc5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:48.163434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8e48-f83c-4198-a7b2-134ab0bbc5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:48.171435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d8e48-f83c-4198-a7b2-134ab0bbc5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:48.173041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d8e48-f83c-4198-a7b2-134ab0bbc5a5 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:48.182210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 718/1431] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:49.017709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5c4b-db2d-45e1-907d-bb7c49a762bf None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:49.018284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5c4b-db2d-45e1-907d-bb7c49a762bf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:49.018284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5c4b-db2d-45e1-907d-bb7c49a762bf None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:49.019688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:49.024729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd5f5-b4f9-4831-81ae-855426941e5d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:49.025187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd5f5-b4f9-4831-81ae-855426941e5d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:49.025325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd5f5-b4f9-4831-81ae-855426941e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:49.043388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e51bd5f5-b4f9-4831-81ae-855426941e5d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:49.044574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e51bd5f5-b4f9-4831-81ae-855426941e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:49.052886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:49.202565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5c4b-db2d-45e1-907d-bb7c49a762bf None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:49.216867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5c4b-db2d-45e1-907d-bb7c49a762bf None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:49.222716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30cf4f-45e5-4c46-8890-7d98e5e3d60a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:49.223347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30cf4f-45e5-4c46-8890-7d98e5e3d60a service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:49.223630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30cf4f-45e5-4c46-8890-7d98e5e3d60a service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:49.223904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30cf4f-45e5-4c46-8890-7d98e5e3d60a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:49.231819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30cf4f-45e5-4c46-8890-7d98e5e3d60a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:49.233427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30cf4f-45e5-4c46-8890-7d98e5e3d60a service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:49.243300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 715/1434] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:50.084781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5c28-11d6-479c-8709-7cd2bb94f43a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:50.085321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5c28-11d6-479c-8709-7cd2bb94f43a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:50.085418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5c28-11d6-479c-8709-7cd2bb94f43a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:50.086763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:50.092020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d22e93-ac02-4288-b947-f509bae0b494 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:50.092433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d22e93-ac02-4288-b947-f509bae0b494 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:50.092586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d22e93-ac02-4288-b947-f509bae0b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:50.110633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-22d22e93-ac02-4288-b947-f509bae0b494 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:50.111835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-22d22e93-ac02-4288-b947-f509bae0b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:50.120789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:50.268570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b5c28-11d6-479c-8709-7cd2bb94f43a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:50.283267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b5c28-11d6-479c-8709-7cd2bb94f43a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:50.289269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0037b-f64c-4b91-a417-c436d6427c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:50.289903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0037b-f64c-4b91-a417-c436d6427c15 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:50.290186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0037b-f64c-4b91-a417-c436d6427c15 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:50.290467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0037b-f64c-4b91-a417-c436d6427c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:50.299040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0037b-f64c-4b91-a417-c436d6427c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:50.300671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0037b-f64c-4b91-a417-c436d6427c15 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:50.310076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 721/1437] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:51.153423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af145-ea4e-415f-a04b-a77c1f2f00f1 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:51.153965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af145-ea4e-415f-a04b-a77c1f2f00f1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:51.153965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af145-ea4e-415f-a04b-a77c1f2f00f1 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:51.155343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:51.161067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7c0df-9f3c-4d0f-b7d1-3b62ac7e70e8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:51.161458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7c0df-9f3c-4d0f-b7d1-3b62ac7e70e8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:51.161636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7c0df-9f3c-4d0f-b7d1-3b62ac7e70e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:51.180062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-52e7c0df-9f3c-4d0f-b7d1-3b62ac7e70e8 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:51.181300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-52e7c0df-9f3c-4d0f-b7d1-3b62ac7e70e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:51.189080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:29:51.338503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484af145-ea4e-415f-a04b-a77c1f2f00f1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:51.353131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484af145-ea4e-415f-a04b-a77c1f2f00f1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:51.358389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d98bab-3efe-4f50-9af9-f7ecdae6950a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:51.359019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d98bab-3efe-4f50-9af9-f7ecdae6950a service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:51.359300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d98bab-3efe-4f50-9af9-f7ecdae6950a service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:51.359572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d98bab-3efe-4f50-9af9-f7ecdae6950a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:51.368061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d98bab-3efe-4f50-9af9-f7ecdae6950a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:51.369669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d98bab-3efe-4f50-9af9-f7ecdae6950a service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:51.378787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 718/1440] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:53.450769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee1b5-aea2-4c72-adfa-195d0ab86fa7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:53.451283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee1b5-aea2-4c72-adfa-195d0ab86fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:53.451283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee1b5-aea2-4c72-adfa-195d0ab86fa7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:53.452592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:53.458411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f946f3a-fade-48aa-9b37-5afd2c05e1af None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:53.458840 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f946f3a-fade-48aa-9b37-5afd2c05e1af None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:53.458982 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f946f3a-fade-48aa-9b37-5afd2c05e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:53.476661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1f946f3a-fade-48aa-9b37-5afd2c05e1af None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:53.477900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1f946f3a-fade-48aa-9b37-5afd2c05e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:53.485722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:53.523534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee1b5-aea2-4c72-adfa-195d0ab86fa7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:53.533908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee1b5-aea2-4c72-adfa-195d0ab86fa7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:53.537364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9be7d-7709-4f19-a883-a4a489e761f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:53.537988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9be7d-7709-4f19-a883-a4a489e761f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:53.538266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9be7d-7709-4f19-a883-a4a489e761f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:53.538541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9be7d-7709-4f19-a883-a4a489e761f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:53.547186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9be7d-7709-4f19-a883-a4a489e761f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:53.548607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9be7d-7709-4f19-a883-a4a489e761f9 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:53.558222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 724/1443] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:55.908908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8c2f5-339a-401e-8a05-b373018394ff None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:55.909958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8c2f5-339a-401e-8a05-b373018394ff None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:55.909958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8c2f5-339a-401e-8a05-b373018394ff None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:55.911291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:55.916546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e64526-fa90-4557-9621-6c2ba2859357 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:55.916978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e64526-fa90-4557-9621-6c2ba2859357 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:55.917133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e64526-fa90-4557-9621-6c2ba2859357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:55.934873 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e5e64526-fa90-4557-9621-6c2ba2859357 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:55.936052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e5e64526-fa90-4557-9621-6c2ba2859357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:55.944077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:55.981962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8c2f5-339a-401e-8a05-b373018394ff None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:55.993138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8c2f5-339a-401e-8a05-b373018394ff None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:55.996588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9423b-6275-445c-bd55-968a16ea7944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:55.997247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9423b-6275-445c-bd55-968a16ea7944 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:55.997526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9423b-6275-445c-bd55-968a16ea7944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:55.997798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9423b-6275-445c-bd55-968a16ea7944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:56.006443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9423b-6275-445c-bd55-968a16ea7944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:56.007889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9423b-6275-445c-bd55-968a16ea7944 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:56.016931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 721/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:29:58.538252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449736e9-59f0-4da7-9b85-6f2c94cd47ab None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:58.538783 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449736e9-59f0-4da7-9b85-6f2c94cd47ab None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:58.538908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449736e9-59f0-4da7-9b85-6f2c94cd47ab None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:58.540182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:58.545325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf76ab-a89a-441c-b257-f0aa293f63a6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:58.545748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf76ab-a89a-441c-b257-f0aa293f63a6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:58.545885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf76ab-a89a-441c-b257-f0aa293f63a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:58.563610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2ecf76ab-a89a-441c-b257-f0aa293f63a6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:58.564723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2ecf76ab-a89a-441c-b257-f0aa293f63a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:58.572821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:29:58.609918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449736e9-59f0-4da7-9b85-6f2c94cd47ab None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:58.620983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449736e9-59f0-4da7-9b85-6f2c94cd47ab None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:58.624407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e61db2-1a06-4505-83cc-7538e22c3f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:58.625065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61db2-1a06-4505-83cc-7538e22c3f99 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:58.625349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61db2-1a06-4505-83cc-7538e22c3f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:58.625624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61db2-1a06-4505-83cc-7538e22c3f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:58.634870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e61db2-1a06-4505-83cc-7538e22c3f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:58.636295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e61db2-1a06-4505-83cc-7538e22c3f99 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:58.645458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 727/1449] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:00.959786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb40e8-bf17-4129-8bfb-844dcc14696b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:00.960409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb40e8-bf17-4129-8bfb-844dcc14696b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:00.960409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb40e8-bf17-4129-8bfb-844dcc14696b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:00.961792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:00.967397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f166e-e7e6-43fc-b327-631a1e159acf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:00.967810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f166e-e7e6-43fc-b327-631a1e159acf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:00.967955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f166e-e7e6-43fc-b327-631a1e159acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:00.985280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fe0f166e-e7e6-43fc-b327-631a1e159acf None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:00.986477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fe0f166e-e7e6-43fc-b327-631a1e159acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:00.994452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:30:01.033725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb40e8-bf17-4129-8bfb-844dcc14696b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:01.044273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb40e8-bf17-4129-8bfb-844dcc14696b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:01.047957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82750c-c73b-4bdd-bf50-dacd0e5a58a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:01.048629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82750c-c73b-4bdd-bf50-dacd0e5a58a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:01.048953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82750c-c73b-4bdd-bf50-dacd0e5a58a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:01.049237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82750c-c73b-4bdd-bf50-dacd0e5a58a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:01.058282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82750c-c73b-4bdd-bf50-dacd0e5a58a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:01.059710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82750c-c73b-4bdd-bf50-dacd0e5a58a5 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:01.069542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 724/1452] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:03.296493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a915-6d99-474e-b0e9-4016443fcd8d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:03.297077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a915-6d99-474e-b0e9-4016443fcd8d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:03.297077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a915-6d99-474e-b0e9-4016443fcd8d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:03.298449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:03.303990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87b8a-80cb-48bd-92b2-4e2caf499413 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:03.304435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87b8a-80cb-48bd-92b2-4e2caf499413 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:03.304535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87b8a-80cb-48bd-92b2-4e2caf499413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:03.322333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8dc87b8a-80cb-48bd-92b2-4e2caf499413 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:03.323521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8dc87b8a-80cb-48bd-92b2-4e2caf499413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:03.331111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:03.368650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89a915-6d99-474e-b0e9-4016443fcd8d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:03.379710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89a915-6d99-474e-b0e9-4016443fcd8d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:03.383229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ef3d-e835-4ce3-a3b4-889097fed6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:03.383862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ef3d-e835-4ce3-a3b4-889097fed6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:03.384145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ef3d-e835-4ce3-a3b4-889097fed6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:03.384424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ef3d-e835-4ce3-a3b4-889097fed6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:03.393216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ef3d-e835-4ce3-a3b4-889097fed6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:03.395244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ef3d-e835-4ce3-a3b4-889097fed6e4 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:03.404491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 730/1455] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:05.612786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5653-3eb4-43f2-ab58-096211445dda None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:05.613353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5653-3eb4-43f2-ab58-096211445dda None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:05.613353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5653-3eb4-43f2-ab58-096211445dda None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:05.614699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:05.620181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8213-d511-4fb6-8396-63c5b22f99c6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:05.620587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8213-d511-4fb6-8396-63c5b22f99c6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:05.620781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8213-d511-4fb6-8396-63c5b22f99c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:05.638548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-88ef8213-d511-4fb6-8396-63c5b22f99c6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:05.639753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-88ef8213-d511-4fb6-8396-63c5b22f99c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:05.648292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:05.685146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5653-3eb4-43f2-ab58-096211445dda None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:05.696051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5653-3eb4-43f2-ab58-096211445dda None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:05.699533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251477b8-e80d-4fc3-81f5-0481c727d3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:05.700169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251477b8-e80d-4fc3-81f5-0481c727d3bd service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:05.700458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251477b8-e80d-4fc3-81f5-0481c727d3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:05.700735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251477b8-e80d-4fc3-81f5-0481c727d3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:05.709997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251477b8-e80d-4fc3-81f5-0481c727d3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:05.711422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251477b8-e80d-4fc3-81f5-0481c727d3bd service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:05.720892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 727/1458] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:07.956313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7ccc-380e-4295-a130-2c682e08e530 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:07.956930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7ccc-380e-4295-a130-2c682e08e530 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:07.956930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7ccc-380e-4295-a130-2c682e08e530 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:07.958276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:07.963989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6441b-818e-4473-b00d-18add09e18f6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:07.964438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6441b-818e-4473-b00d-18add09e18f6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:07.964544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6441b-818e-4473-b00d-18add09e18f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:07.970573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=70 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:07.983383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9cc6441b-818e-4473-b00d-18add09e18f6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:07.984560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9cc6441b-818e-4473-b00d-18add09e18f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:07.992915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:08.029260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7ccc-380e-4295-a130-2c682e08e530 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:08.035209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=73 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:08.041578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7ccc-380e-4295-a130-2c682e08e530 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:08.045099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e043e3-72fb-40d3-beb9-e3b152d87293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:08.045764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e043e3-72fb-40d3-beb9-e3b152d87293 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:08.046048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e043e3-72fb-40d3-beb9-e3b152d87293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:08.046330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e043e3-72fb-40d3-beb9-e3b152d87293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:08.055087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e043e3-72fb-40d3-beb9-e3b152d87293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:08.056516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e043e3-72fb-40d3-beb9-e3b152d87293 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:08.065858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 733/1461] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:10.352970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477174-a0df-4eab-ab58-1034afc8e6ea None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:10.353506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477174-a0df-4eab-ab58-1034afc8e6ea None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:10.353621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477174-a0df-4eab-ab58-1034afc8e6ea None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:10.354966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:10.360352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b325e-1ac1-44cf-8bbe-d6da3d4d8cd6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:10.360781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b325e-1ac1-44cf-8bbe-d6da3d4d8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:10.360955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b325e-1ac1-44cf-8bbe-d6da3d4d8cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:10.378575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-561b325e-1ac1-44cf-8bbe-d6da3d4d8cd6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:10.379766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-561b325e-1ac1-44cf-8bbe-d6da3d4d8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:10.387478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:10.424085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92477174-a0df-4eab-ab58-1034afc8e6ea None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:10.435006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92477174-a0df-4eab-ab58-1034afc8e6ea None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:10.438554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae27810-5fe8-4a08-8f6e-2e4a32f776f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:10.439185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae27810-5fe8-4a08-8f6e-2e4a32f776f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:10.439472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae27810-5fe8-4a08-8f6e-2e4a32f776f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:10.439753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae27810-5fe8-4a08-8f6e-2e4a32f776f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:10.448505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae27810-5fe8-4a08-8f6e-2e4a32f776f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:10.449971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae27810-5fe8-4a08-8f6e-2e4a32f776f9 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:10.459769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 730/1464] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:30:12.625361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51832c51-eb98-4ab5-979a-d77e0018b4b1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:12.625878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51832c51-eb98-4ab5-979a-d77e0018b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:12.625878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51832c51-eb98-4ab5-979a-d77e0018b4b1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:12.627205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:12.632989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db271-45b2-40f1-a583-03aad5f5179e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:12.633399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db271-45b2-40f1-a583-03aad5f5179e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:12.633553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db271-45b2-40f1-a583-03aad5f5179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:12.650890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-559db271-45b2-40f1-a583-03aad5f5179e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:12.652077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-559db271-45b2-40f1-a583-03aad5f5179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:12.659700 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:30:12.695805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51832c51-eb98-4ab5-979a-d77e0018b4b1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:12.706398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51832c51-eb98-4ab5-979a-d77e0018b4b1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:12.709973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5ca2f-4e70-407d-9b81-17f012509bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:12.710649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ca2f-4e70-407d-9b81-17f012509bdb service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:12.710932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ca2f-4e70-407d-9b81-17f012509bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:12.711210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ca2f-4e70-407d-9b81-17f012509bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:12.720380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5ca2f-4e70-407d-9b81-17f012509bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:12.721851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5ca2f-4e70-407d-9b81-17f012509bdb service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:12.731093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 736/1467] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:14.929806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4f801-e410-48b9-b0ec-183a2b398d1b None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:14.930398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4f801-e410-48b9-b0ec-183a2b398d1b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:14.930398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4f801-e410-48b9-b0ec-183a2b398d1b None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:14.931770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:14.937021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db420f-09de-4671-af0c-791b8357f887 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:14.937420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db420f-09de-4671-af0c-791b8357f887 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:14.937586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db420f-09de-4671-af0c-791b8357f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:14.954899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-60db420f-09de-4671-af0c-791b8357f887 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:14.956618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-60db420f-09de-4671-af0c-791b8357f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:14.964536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:15.000294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4f801-e410-48b9-b0ec-183a2b398d1b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:15.010762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4f801-e410-48b9-b0ec-183a2b398d1b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:15.014234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f032b-8157-4c2a-8d75-dcd01646509b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:15.014860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f032b-8157-4c2a-8d75-dcd01646509b service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:15.015139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f032b-8157-4c2a-8d75-dcd01646509b service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:15.015413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f032b-8157-4c2a-8d75-dcd01646509b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:15.024675 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f032b-8157-4c2a-8d75-dcd01646509b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:15.026111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f032b-8157-4c2a-8d75-dcd01646509b service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:15.035817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 733/1470] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:24.949964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=17 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:25.031110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=17 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:47.811062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ed379-8433-4998-b88b-16233fcb761a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:47.811623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ed379-8433-4998-b88b-16233fcb761a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:47.811623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ed379-8433-4998-b88b-16233fcb761a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:47.813038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 738/1471] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:47.818626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10907e-1385-4277-a5c9-08217ee71c1d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:47.819089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10907e-1385-4277-a5c9-08217ee71c1d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:47.819200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10907e-1385-4277-a5c9-08217ee71c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:47.838298 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9e10907e-1385-4277-a5c9-08217ee71c1d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:47.839760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9e10907e-1385-4277-a5c9-08217ee71c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:47.848800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 734/1472] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:47.896045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae494ec-a9dc-4906-a7b3-a92c119457d4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:47.896334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae494ec-a9dc-4906-a7b3-a92c119457d4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:47.896616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae494ec-a9dc-4906-a7b3-a92c119457d4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:47.898281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 739/1473] 10.222.0.79 () {54 vars in 962 bytes} [Fri May 27 09:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:47.902951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f5726-2a4e-4e96-855c-02854a6ba590 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:47.903237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f5726-2a4e-4e96-855c-02854a6ba590 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:47.903517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f5726-2a4e-4e96-855c-02854a6ba590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:47.922248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-301f5726-2a4e-4e96-855c-02854a6ba590 None None] MFA Rules not processed for user `2b11f7990b364f5281def98b941e1e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:47.923546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-301f5726-2a4e-4e96-855c-02854a6ba590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:47.930383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 735/1474] 10.222.0.79 () {58 vars in 1059 bytes} [Fri May 27 09:30:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:47.937607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae494ec-a9dc-4906-a7b3-a92c119457d4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:47.948481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae494ec-a9dc-4906-a7b3-a92c119457d4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:47.952307 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf4e7e-f401-4b98-9ba5-ba3a4ee4f041 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:47.952972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf4e7e-f401-4b98-9ba5-ba3a4ee4f041 service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:47.953247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf4e7e-f401-4b98-9ba5-ba3a4ee4f041 service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:47.953520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf4e7e-f401-4b98-9ba5-ba3a4ee4f041 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:47.964721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf4e7e-f401-4b98-9ba5-ba3a4ee4f041 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:47.966229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf4e7e-f401-4b98-9ba5-ba3a4ee4f041 service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:47.976469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 740/1475] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:50.284502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a2f2-4449-4eb1-86bd-f4ebe3c568c1 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:50.285076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a2f2-4449-4eb1-86bd-f4ebe3c568c1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:50.285076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a2f2-4449-4eb1-86bd-f4ebe3c568c1 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:50.286479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 736/1476] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:50.291785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9208-843f-4f66-9f3e-2945818cc426 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:50.292235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9208-843f-4f66-9f3e-2945818cc426 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:50.292329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9208-843f-4f66-9f3e-2945818cc426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:50.312676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e34f9208-843f-4f66-9f3e-2945818cc426 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:50.313939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e34f9208-843f-4f66-9f3e-2945818cc426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:50.322071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 741/1477] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:50.345866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a2f2-4449-4eb1-86bd-f4ebe3c568c1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:50.359130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a2f2-4449-4eb1-86bd-f4ebe3c568c1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:50.363678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a7107-6b16-432e-b8c7-d5d554479755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:50.364336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7107-6b16-432e-b8c7-d5d554479755 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:50.364617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7107-6b16-432e-b8c7-d5d554479755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:50.364924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7107-6b16-432e-b8c7-d5d554479755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:50.365658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a7107-6b16-432e-b8c7-d5d554479755 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:50.367423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING py.warnings [None req-674a7107-6b16-432e-b8c7-d5d554479755 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:30:50.367423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: warnings.warn(msg) May 27 09:30:50.367423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: May 27 09:30:50.368590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a7107-6b16-432e-b8c7-d5d554479755 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:50.388477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 737/1478] 10.222.0.79 () {56 vars in 1108 bytes} [Fri May 27 09:30:50 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:30:52.595211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094097e-1192-4037-8084-c215aacdb819 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:52.595733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094097e-1192-4037-8084-c215aacdb819 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:52.595733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094097e-1192-4037-8084-c215aacdb819 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:52.597110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 742/1479] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:52.602234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16993-f708-4688-9371-806289191d1d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:52.602690 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16993-f708-4688-9371-806289191d1d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:52.602803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16993-f708-4688-9371-806289191d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:52.621320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3ad16993-f708-4688-9371-806289191d1d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:52.622536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3ad16993-f708-4688-9371-806289191d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:52.630973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 738/1480] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:52.673021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094097e-1192-4037-8084-c215aacdb819 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:52.687713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094097e-1192-4037-8084-c215aacdb819 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:52.693348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340355ff-f114-4aad-8e1e-e8c38dcc0d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:52.693984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340355ff-f114-4aad-8e1e-e8c38dcc0d89 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:52.694270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340355ff-f114-4aad-8e1e-e8c38dcc0d89 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:52.694552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340355ff-f114-4aad-8e1e-e8c38dcc0d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:52.702754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340355ff-f114-4aad-8e1e-e8c38dcc0d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:52.704602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340355ff-f114-4aad-8e1e-e8c38dcc0d89 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:52.714664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 743/1481] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:55.105008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dff71-c34a-4b98-83f6-91911a25bf40 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:55.105572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dff71-c34a-4b98-83f6-91911a25bf40 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:55.105572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dff71-c34a-4b98-83f6-91911a25bf40 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:55.106923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 739/1482] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:55.112067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd0a2-3ddd-4b7b-b7d8-07c6731530e1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:55.112505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd0a2-3ddd-4b7b-b7d8-07c6731530e1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:55.112614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd0a2-3ddd-4b7b-b7d8-07c6731530e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:55.131259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-94ebd0a2-3ddd-4b7b-b7d8-07c6731530e1 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:55.132448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-94ebd0a2-3ddd-4b7b-b7d8-07c6731530e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:55.140160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 744/1483] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:55.175793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dff71-c34a-4b98-83f6-91911a25bf40 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:55.186200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dff71-c34a-4b98-83f6-91911a25bf40 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:55.190169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88006d-d4f5-493f-8bff-91dc9440de65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:55.190830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88006d-d4f5-493f-8bff-91dc9440de65 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:55.191110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88006d-d4f5-493f-8bff-91dc9440de65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:55.191382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88006d-d4f5-493f-8bff-91dc9440de65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:55.200389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88006d-d4f5-493f-8bff-91dc9440de65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:55.201853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88006d-d4f5-493f-8bff-91dc9440de65 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:55.212083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 740/1484] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:57.454577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12fa6-acc0-4234-a340-281e75c7df69 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:57.455084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12fa6-acc0-4234-a340-281e75c7df69 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:57.455084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12fa6-acc0-4234-a340-281e75c7df69 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:57.456460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 745/1485] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:57.461858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3dd8-d2ec-496d-8bf1-d46e5014a3e8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:57.462286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3dd8-d2ec-496d-8bf1-d46e5014a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:57.462412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3dd8-d2ec-496d-8bf1-d46e5014a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:57.480382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5d4e3dd8-d2ec-496d-8bf1-d46e5014a3e8 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:57.481597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5d4e3dd8-d2ec-496d-8bf1-d46e5014a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:57.489890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 741/1486] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:57.527302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc12fa6-acc0-4234-a340-281e75c7df69 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:57.538471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc12fa6-acc0-4234-a340-281e75c7df69 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:57.541966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d3ccc-7177-43ee-a7c4-60553b756b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:57.542599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d3ccc-7177-43ee-a7c4-60553b756b8e service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:57.542885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d3ccc-7177-43ee-a7c4-60553b756b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:57.543171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d3ccc-7177-43ee-a7c4-60553b756b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:57.552364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d3ccc-7177-43ee-a7c4-60553b756b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:57.553843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d3ccc-7177-43ee-a7c4-60553b756b8e service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:57.563276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 746/1487] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:59.827627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729a094-7534-4e61-93fb-1784c954b702 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:59.828087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729a094-7534-4e61-93fb-1784c954b702 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:59.828201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729a094-7534-4e61-93fb-1784c954b702 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:59.829592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 742/1488] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:59.835389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465693d-8a22-41ac-b8a9-ebfb3919eb83 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:59.835823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465693d-8a22-41ac-b8a9-ebfb3919eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:59.835986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465693d-8a22-41ac-b8a9-ebfb3919eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:59.854452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1465693d-8a22-41ac-b8a9-ebfb3919eb83 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:59.855646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1465693d-8a22-41ac-b8a9-ebfb3919eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:59.863478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 747/1489] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:59.903146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729a094-7534-4e61-93fb-1784c954b702 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:59.914048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729a094-7534-4e61-93fb-1784c954b702 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:59.917518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22682ac5-3b9f-474c-8e2f-a1583895f89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:59.918130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22682ac5-3b9f-474c-8e2f-a1583895f89c service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:59.918409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22682ac5-3b9f-474c-8e2f-a1583895f89c service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:59.918680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22682ac5-3b9f-474c-8e2f-a1583895f89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:59.927240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22682ac5-3b9f-474c-8e2f-a1583895f89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:59.928654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22682ac5-3b9f-474c-8e2f-a1583895f89c service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:59.937752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 743/1490] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:02.289358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d1264-fca5-4548-988d-acd0abd4fe36 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:02.289956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d1264-fca5-4548-988d-acd0abd4fe36 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:02.289956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d1264-fca5-4548-988d-acd0abd4fe36 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:02.291301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 748/1491] 10.222.0.79 () {54 vars in 926 bytes} [Fri May 27 09:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:02.296756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfaa89-9970-4431-987c-87ddb1968828 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:02.297244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfaa89-9970-4431-987c-87ddb1968828 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:02.297577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfaa89-9970-4431-987c-87ddb1968828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:02.316440 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-55cfaa89-9970-4431-987c-87ddb1968828 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:02.317796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-55cfaa89-9970-4431-987c-87ddb1968828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:02.326981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 744/1492] 10.222.0.79 () {58 vars in 1023 bytes} [Fri May 27 09:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:31:02.365600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d1264-fca5-4548-988d-acd0abd4fe36 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:02.376451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d1264-fca5-4548-988d-acd0abd4fe36 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:02.380525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd70cf-60f3-4bac-b3a9-3e8f30becd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:02.381183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd70cf-60f3-4bac-b3a9-3e8f30becd46 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:02.381463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd70cf-60f3-4bac-b3a9-3e8f30becd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:02.381737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd70cf-60f3-4bac-b3a9-3e8f30becd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:02.390358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd70cf-60f3-4bac-b3a9-3e8f30becd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:02.391782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd70cf-60f3-4bac-b3a9-3e8f30becd46 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:02.400967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 749/1493] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:12.310336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=33 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:12.396871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=33 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:41.638064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671b2a2-bcac-4391-81dc-2f06fbd79bc3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:41.638625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671b2a2-bcac-4391-81dc-2f06fbd79bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:41.638625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671b2a2-bcac-4391-81dc-2f06fbd79bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:41.656128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c671b2a2-bcac-4391-81dc-2f06fbd79bc3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:41.657353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c671b2a2-bcac-4391-81dc-2f06fbd79bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:41.665673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 745/1494] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:41.675210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590989d-f240-4581-ba73-ca8d8f60e313 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:41.675697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590989d-f240-4581-ba73-ca8d8f60e313 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:41.675804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590989d-f240-4581-ba73-ca8d8f60e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:41.693804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7590989d-f240-4581-ba73-ca8d8f60e313 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:41.694977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7590989d-f240-4581-ba73-ca8d8f60e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:41.702700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 750/1495] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:32:41.707556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671b2a2-bcac-4391-81dc-2f06fbd79bc3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:41.717300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671b2a2-bcac-4391-81dc-2f06fbd79bc3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:41.722367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:41.723015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:41.723302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:41.723582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:41.724299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:32:41.724610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:41.725660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING py.warnings [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:41.725660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: warnings.warn(msg) May 27 09:32:41.725660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: May 27 09:32:41.726544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:41.737936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 746/1496] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:32:41.745679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590989d-f240-4581-ba73-ca8d8f60e313 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:41.754429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590989d-f240-4581-ba73-ca8d8f60e313 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:41.759109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:41.759740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:41.760020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:41.760291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:41.760990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:41.762727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:41.762727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: warnings.warn(msg) May 27 09:32:41.762727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: May 27 09:32:41.763926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:41.800115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 751/1497] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:32:41 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:32:41.804389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:41.814271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ca7fb-744f-4b97-a49b-4b90c4abad4b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:41.869416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:41.870086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:41.870372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:41.870649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:41.871369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:41.872387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING py.warnings [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:41.872387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: warnings.warn(msg) May 27 09:32:41.872387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: May 27 09:32:41.873653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:41.893554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 747/1498] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:32:41 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:32:41.897708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:41.908376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb44464-58a4-487c-8f8c-cfd10d3529be admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:41.912953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:41.913611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:41.913897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:41.914176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:41.914896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:41.915915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:41.915915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: warnings.warn(msg) May 27 09:32:41.915915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: May 27 09:32:41.916797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:41.929304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 752/1499] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:32:41.933195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:41.942924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2418a64-10ea-4f53-a48a-deec9e923666 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:41.947443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9365-6b04-4e95-b1e2-7bc311f00153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:41.948089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9365-6b04-4e95-b1e2-7bc311f00153 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:41.948374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9365-6b04-4e95-b1e2-7bc311f00153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:41.948650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9365-6b04-4e95-b1e2-7bc311f00153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:41.949409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9365-6b04-4e95-b1e2-7bc311f00153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:41.950412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING py.warnings [None req-584d9365-6b04-4e95-b1e2-7bc311f00153 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:41.950412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: warnings.warn(msg) May 27 09:32:41.950412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: May 27 09:32:41.951287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9365-6b04-4e95-b1e2-7bc311f00153 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:41.964811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 748/1500] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:32:41.968963 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:41.979107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52285118-a15c-4ee3-ad72-2f8d27eeb18c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:41.983576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a6d5e-0e54-4f4a-b0a0-fb6b157a52c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:41.984445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a6d5e-0e54-4f4a-b0a0-fb6b157a52c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:41.984738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a6d5e-0e54-4f4a-b0a0-fb6b157a52c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:41.985050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a6d5e-0e54-4f4a-b0a0-fb6b157a52c2 admin admin] PATH_INFO: `/v3/projects/8991af797c7146ccbfe54c094648a071/users/5ed318fa8a094571944709a3c7e364dc/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.005540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a6d5e-0e54-4f4a-b0a0-fb6b157a52c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8991af797c7146ccbfe54c094648a071, user_id=5ed318fa8a094571944709a3c7e364dc, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:42.006573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-a15a6d5e-0e54-4f4a-b0a0-fb6b157a52c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:42.006573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: warnings.warn(msg) May 27 09:32:42.006573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: May 27 09:32:42.008497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a6d5e-0e54-4f4a-b0a0-fb6b157a52c2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:42.021341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 753/1501] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:32:41 2022] PUT /identity/v3/projects/8991af797c7146ccbfe54c094648a071/users/5ed318fa8a094571944709a3c7e364dc/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:32:42.032304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86d43-84ba-426d-b545-ff33c71a61a2 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.033328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86d43-84ba-426d-b545-ff33c71a61a2 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.033615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86d43-84ba-426d-b545-ff33c71a61a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.058966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-eef86d43-84ba-426d-b545-ff33c71a61a2 None None] MFA Rules not processed for user `5ed318fa8a094571944709a3c7e364dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:42.060176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-eef86d43-84ba-426d-b545-ff33c71a61a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:42.122181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 749/1502] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:42.136082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878e4e-984e-44bb-9375-81d06345c3c4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.136378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878e4e-984e-44bb-9375-81d06345c3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.136662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878e4e-984e-44bb-9375-81d06345c3c4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.138073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 754/1503] 10.222.0.79 () {54 vars in 963 bytes} [Fri May 27 09:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:42.143621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a0767-713b-4978-91ed-1671af36d584 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.143852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a0767-713b-4978-91ed-1671af36d584 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.144128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a0767-713b-4978-91ed-1671af36d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.161932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b85a0767-713b-4978-91ed-1671af36d584 None None] MFA Rules not processed for user `fe6a8bf853cd4b60916375d9ebbd468f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:42.163123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b85a0767-713b-4978-91ed-1671af36d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:42.206761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:42.215077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 750/1504] 10.222.0.79 () {58 vars in 1060 bytes} [Fri May 27 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:42.223105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34878e4e-984e-44bb-9375-81d06345c3c4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:42.233561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34878e4e-984e-44bb-9375-81d06345c3c4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:42.237066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a717e-6d13-49c8-abc5-bbde16450987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:42.237696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a717e-6d13-49c8-abc5-bbde16450987 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.237979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a717e-6d13-49c8-abc5-bbde16450987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.238258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a717e-6d13-49c8-abc5-bbde16450987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.246395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a717e-6d13-49c8-abc5-bbde16450987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:42.247824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a717e-6d13-49c8-abc5-bbde16450987 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:42.257618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 755/1505] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:32:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:42.299165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1eb08-685b-41cb-b996-379bbd57d1a4 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.299453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1eb08-685b-41cb-b996-379bbd57d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.299734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1eb08-685b-41cb-b996-379bbd57d1a4 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.301068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 751/1506] 10.222.0.79 () {52 vars in 829 bytes} [Fri May 27 09:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:42.304600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a717e-6d13-49c8-abc5-bbde16450987 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:42.367694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a717e-6d13-49c8-abc5-bbde16450987 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:42.372241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:42.373142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.373423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.373696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] PATH_INFO: `/v3/users/5ed318fa8a094571944709a3c7e364dc` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.374856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed318fa8a094571944709a3c7e364dc)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:42.375865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:42.375865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: warnings.warn(msg) May 27 09:32:42.375865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: May 27 09:32:42.377633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:42.439824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed318fa8a094571944709a3c7e364dc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:42.458399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed318fa8a094571944709a3c7e364dc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:42.468479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed318fa8a094571944709a3c7e364dc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:42.469295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed318fa8a094571944709a3c7e364dc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:42.471071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed318fa8a094571944709a3c7e364dc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:42.479551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:42.491413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 756/1507] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:32:42 2022] DELETE /identity/v3/users/5ed318fa8a094571944709a3c7e364dc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:32:42.496019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e26ef-5bdd-4fa9-a750-276bf6c67cdf None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.496308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e26ef-5bdd-4fa9-a750-276bf6c67cdf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.496592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e26ef-5bdd-4fa9-a750-276bf6c67cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.514074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1f6e26ef-5bdd-4fa9-a750-276bf6c67cdf None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:42.515253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1f6e26ef-5bdd-4fa9-a750-276bf6c67cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:42.571989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 752/1508] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:32:42.581621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:42.583033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:42.640278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d34478-9d7f-4cce-b7e6-40cebdc87c11 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:42.643824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187d3eb-2e3a-4fbe-b055-91ad747919ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:42.644460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d3eb-2e3a-4fbe-b055-91ad747919ca service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:42.644737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d3eb-2e3a-4fbe-b055-91ad747919ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:42.645038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d3eb-2e3a-4fbe-b055-91ad747919ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:42.653717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187d3eb-2e3a-4fbe-b055-91ad747919ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:42.655146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187d3eb-2e3a-4fbe-b055-91ad747919ca service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:42.664247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 757/1509] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:42.990130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e26ef-5bdd-4fa9-a750-276bf6c67cdf None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:42.991616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1f6e26ef-5bdd-4fa9-a750-276bf6c67cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:43.003218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e26ef-5bdd-4fa9-a750-276bf6c67cdf None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:43.007874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:43.014510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:43.014839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:43.015125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] PATH_INFO: `/v3/projects/8991af797c7146ccbfe54c094648a071` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:43.016530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8991af797c7146ccbfe54c094648a071)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:43.018184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING py.warnings [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:32:43.018184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: warnings.warn(msg) May 27 09:32:43.018184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: May 27 09:32:43.019638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:43.088328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8991af797c7146ccbfe54c094648a071', 'request_id': 'req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:43.102115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8991af797c7146ccbfe54c094648a071', 'request_id': 'req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:43.108321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8991af797c7146ccbfe54c094648a071', 'request_id': 'req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:43.123664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] The token cache is being invalidate because project 8991af797c7146ccbfe54c094648a071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:32:43.123950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:43.124606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c09b5bdc-f3d0-49f1-ba19-c28b4171939a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:32:43.126337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 753/1510] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:32:42 2022] DELETE /identity/v3/projects/8991af797c7146ccbfe54c094648a071 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:32:52.660320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=29 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:53.120479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:34:35.923500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1e2ae-427f-4e50-81b7-5f98ea73684c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:35.923962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1e2ae-427f-4e50-81b7-5f98ea73684c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:35.924069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1e2ae-427f-4e50-81b7-5f98ea73684c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:35.925475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:35.930286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba552-13d9-4bf1-9535-f328833185d4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:35.930742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba552-13d9-4bf1-9535-f328833185d4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:35.930850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba552-13d9-4bf1-9535-f328833185d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:35.950602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8baba552-13d9-4bf1-9535-f328833185d4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:35.951762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8baba552-13d9-4bf1-9535-f328833185d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:36.007370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:36.176053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1e2ae-427f-4e50-81b7-5f98ea73684c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:36.177800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2bd1e2ae-427f-4e50-81b7-5f98ea73684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:36.251442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1e2ae-427f-4e50-81b7-5f98ea73684c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:36.256735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f09074-ebee-46c4-b361-2c179a8a6b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:36.257409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f09074-ebee-46c4-b361-2c179a8a6b99 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:36.258216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f09074-ebee-46c4-b361-2c179a8a6b99 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:36.258495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f09074-ebee-46c4-b361-2c179a8a6b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:36.266587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f09074-ebee-46c4-b361-2c179a8a6b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:36.268189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f09074-ebee-46c4-b361-2c179a8a6b99 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:36.277632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 759/1513] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:37.129214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9de1d-e96d-4c7f-aaf8-8ae50e3fc49c None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:37.129766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9de1d-e96d-4c7f-aaf8-8ae50e3fc49c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:37.129766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9de1d-e96d-4c7f-aaf8-8ae50e3fc49c None None] PATH_INFO: `/v3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:37.131084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 755/1514] 10.222.0.76 () {54 vars in 925 bytes} [Fri May 27 09:34:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:34:37.137985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4f89-6419-4e66-b149-2400d878c6d1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:37.138448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4f89-6419-4e66-b149-2400d878c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:37.138572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4f89-6419-4e66-b149-2400d878c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:37.146942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7b5e-950c-42bb-8e32-5c50c273bad1 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:37.147278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7b5e-950c-42bb-8e32-5c50c273bad1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:37.147559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7b5e-950c-42bb-8e32-5c50c273bad1 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:37.149467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 756/1515] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:34:37.153932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a614bb-92d4-41da-b0f4-860a80002adb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:37.154217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a614bb-92d4-41da-b0f4-860a80002adb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:37.154490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a614bb-92d4-41da-b0f4-860a80002adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:37.157094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0bbf4f89-6419-4e66-b149-2400d878c6d1 None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:37.158311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0bbf4f89-6419-4e66-b149-2400d878c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:37.173497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-22a614bb-92d4-41da-b0f4-860a80002adb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:37.174688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-22a614bb-92d4-41da-b0f4-860a80002adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:37.182687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 757/1516] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:34:37.222957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 760/1517] 10.222.0.76 () {58 vars in 1015 bytes} [Fri May 27 09:34:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:37.333325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a614bb-92d4-41da-b0f4-860a80002adb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:37.346179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a614bb-92d4-41da-b0f4-860a80002adb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:37.352109 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ef6dc-01bf-45c2-9bc0-3f0b28b05b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:37.352746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef6dc-01bf-45c2-9bc0-3f0b28b05b7b service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:37.353058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef6dc-01bf-45c2-9bc0-3f0b28b05b7b service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:37.353337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef6dc-01bf-45c2-9bc0-3f0b28b05b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:37.361228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ef6dc-01bf-45c2-9bc0-3f0b28b05b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:37.362827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ef6dc-01bf-45c2-9bc0-3f0b28b05b7b service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:37.371980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 758/1518] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:46.597399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c80485-4894-4e02-8320-6ac71f184a60 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:46.597949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c80485-4894-4e02-8320-6ac71f184a60 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:46.597949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c80485-4894-4e02-8320-6ac71f184a60 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:46.599367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 761/1519] 10.222.0.79 () {54 vars in 960 bytes} [Fri May 27 09:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:46.604861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655f64c-e78f-462f-9cdf-28e41d487d60 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:46.605248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655f64c-e78f-462f-9cdf-28e41d487d60 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:46.605431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655f64c-e78f-462f-9cdf-28e41d487d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:46.623952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a655f64c-e78f-462f-9cdf-28e41d487d60 None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:46.625306 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a655f64c-e78f-462f-9cdf-28e41d487d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:46.633929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 759/1520] 10.222.0.79 () {58 vars in 1057 bytes} [Fri May 27 09:34:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:46.641607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c80485-4894-4e02-8320-6ac71f184a60 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:46.654426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c80485-4894-4e02-8320-6ac71f184a60 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:46.659258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af933ee2-6a15-4613-8fca-2e2e16ca2a2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:46.659882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933ee2-6a15-4613-8fca-2e2e16ca2a2f service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:46.660162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933ee2-6a15-4613-8fca-2e2e16ca2a2f service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:46.660436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af933ee2-6a15-4613-8fca-2e2e16ca2a2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:46.669076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af933ee2-6a15-4613-8fca-2e2e16ca2a2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:46.670650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af933ee2-6a15-4613-8fca-2e2e16ca2a2f service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:46.680691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 762/1521] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:34:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:34:48.643961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53606707-82b2-4a60-a243-e5ea0e9dc611 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:48.644526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53606707-82b2-4a60-a243-e5ea0e9dc611 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:48.644526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53606707-82b2-4a60-a243-e5ea0e9dc611 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:48.645864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:48.651345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b8c6-3b96-441d-b752-ff1a5c68ae8f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:48.651798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b8c6-3b96-441d-b752-ff1a5c68ae8f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:48.651894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b8c6-3b96-441d-b752-ff1a5c68ae8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:48.792674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d8d1b8c6-3b96-441d-b752-ff1a5c68ae8f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:48.793951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d8d1b8c6-3b96-441d-b752-ff1a5c68ae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:48.801839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:48.954186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53606707-82b2-4a60-a243-e5ea0e9dc611 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:48.970271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53606707-82b2-4a60-a243-e5ea0e9dc611 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:48.975540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d796f98-53aa-413a-a7bb-2c72b1db954e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:48.976167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d796f98-53aa-413a-a7bb-2c72b1db954e service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:48.976490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d796f98-53aa-413a-a7bb-2c72b1db954e service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:48.977323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d796f98-53aa-413a-a7bb-2c72b1db954e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:48.985287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d796f98-53aa-413a-a7bb-2c72b1db954e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:48.986831 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d796f98-53aa-413a-a7bb-2c72b1db954e service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:48.995881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 761/1524] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:34:49.851069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539b99-1e2b-42c9-b595-257c6d40a6b0 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:49.851593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539b99-1e2b-42c9-b595-257c6d40a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:49.851716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539b99-1e2b-42c9-b595-257c6d40a6b0 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:49.853094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:49.857985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413d70-5467-4e29-bc28-79da238870e3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:49.858423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413d70-5467-4e29-bc28-79da238870e3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:49.858533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413d70-5467-4e29-bc28-79da238870e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:49.876528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-eb413d70-5467-4e29-bc28-79da238870e3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:49.877761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-eb413d70-5467-4e29-bc28-79da238870e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:49.886443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:34:50.034625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12539b99-1e2b-42c9-b595-257c6d40a6b0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:50.048841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12539b99-1e2b-42c9-b595-257c6d40a6b0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:50.054213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9c19f-dd74-4706-b74e-0f2393e7f67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:50.055347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c19f-dd74-4706-b74e-0f2393e7f67e service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:50.055628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c19f-dd74-4706-b74e-0f2393e7f67e service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:50.055903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c19f-dd74-4706-b74e-0f2393e7f67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:50.063912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9c19f-dd74-4706-b74e-0f2393e7f67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:50.065528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9c19f-dd74-4706-b74e-0f2393e7f67e service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:50.075282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 765/1527] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:54.466900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f42fa-14a7-48bb-9d84-a63d4a91398e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:54.467428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f42fa-14a7-48bb-9d84-a63d4a91398e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:54.467524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f42fa-14a7-48bb-9d84-a63d4a91398e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:54.468896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:54.474280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721929-7e60-49f0-93d2-520029592ed0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:54.474697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721929-7e60-49f0-93d2-520029592ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:54.474843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721929-7e60-49f0-93d2-520029592ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:54.492924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-47721929-7e60-49f0-93d2-520029592ed0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:54.494135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-47721929-7e60-49f0-93d2-520029592ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:54.501932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:54.541591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f42fa-14a7-48bb-9d84-a63d4a91398e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:54.543301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-575f42fa-14a7-48bb-9d84-a63d4a91398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:54.600066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f42fa-14a7-48bb-9d84-a63d4a91398e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:54.604082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb90d96-bca6-409f-9044-4c5e222d4529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:54.604721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb90d96-bca6-409f-9044-4c5e222d4529 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:54.605038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb90d96-bca6-409f-9044-4c5e222d4529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:54.605322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb90d96-bca6-409f-9044-4c5e222d4529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:54.614120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb90d96-bca6-409f-9044-4c5e222d4529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:54.615544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb90d96-bca6-409f-9044-4c5e222d4529 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:54.625368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 764/1530] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:34:56.823459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26ece8-1032-41ee-ae7a-5fe0467be618 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:56.824010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26ece8-1032-41ee-ae7a-5fe0467be618 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:56.824010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26ece8-1032-41ee-ae7a-5fe0467be618 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:56.825433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:34:56.830506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c373-1be1-47d7-869b-39c3db2009f0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:56.830932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c373-1be1-47d7-869b-39c3db2009f0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:56.831074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c373-1be1-47d7-869b-39c3db2009f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:56.851442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-67c6c373-1be1-47d7-869b-39c3db2009f0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:34:56.852681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-67c6c373-1be1-47d7-869b-39c3db2009f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:34:56.860300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:34:56.895231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26ece8-1032-41ee-ae7a-5fe0467be618 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:34:56.906865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26ece8-1032-41ee-ae7a-5fe0467be618 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:34:56.910389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20107cfc-90d1-4aa4-b3c2-3f2f9a6c3d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:34:56.911016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107cfc-90d1-4aa4-b3c2-3f2f9a6c3d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:34:56.911298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107cfc-90d1-4aa4-b3c2-3f2f9a6c3d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:34:56.911576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107cfc-90d1-4aa4-b3c2-3f2f9a6c3d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:34:56.921035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20107cfc-90d1-4aa4-b3c2-3f2f9a6c3d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:34:56.922457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20107cfc-90d1-4aa4-b3c2-3f2f9a6c3d4c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:34:56.932256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 768/1533] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:35:00.872319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd7e31-780d-413a-9fc3-cdf28998d437 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:00.872904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd7e31-780d-413a-9fc3-cdf28998d437 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:00.873020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd7e31-780d-413a-9fc3-cdf28998d437 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:00.874340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:35:00.879658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5124-a5bf-42ba-b929-b00a18705e42 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:00.880108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5124-a5bf-42ba-b929-b00a18705e42 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:00.880214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5124-a5bf-42ba-b929-b00a18705e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:00.898645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6b5e5124-a5bf-42ba-b929-b00a18705e42 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:35:00.899830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6b5e5124-a5bf-42ba-b929-b00a18705e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:00.907543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:01.180729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd7e31-780d-413a-9fc3-cdf28998d437 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:01.182426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bafd7e31-780d-413a-9fc3-cdf28998d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:01.238232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd7e31-780d-413a-9fc3-cdf28998d437 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:01.242223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d02f9b-ba86-4365-8986-274b1e7c7593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:01.242859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02f9b-ba86-4365-8986-274b1e7c7593 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:01.243144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02f9b-ba86-4365-8986-274b1e7c7593 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:01.243423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02f9b-ba86-4365-8986-274b1e7c7593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:01.249179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:35:01.253299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d02f9b-ba86-4365-8986-274b1e7c7593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:01.254724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d02f9b-ba86-4365-8986-274b1e7c7593 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:01.264526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 767/1536] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:35:03.462475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060592ef-8d19-44e2-bad3-246ee0ed7c2d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:03.463004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060592ef-8d19-44e2-bad3-246ee0ed7c2d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:03.463103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060592ef-8d19-44e2-bad3-246ee0ed7c2d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:03.464424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:35:03.470054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea5f78-fb92-4c1c-8669-fd94759842ba None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:03.470460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea5f78-fb92-4c1c-8669-fd94759842ba None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:03.470648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea5f78-fb92-4c1c-8669-fd94759842ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:03.488296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-59ea5f78-fb92-4c1c-8669-fd94759842ba None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:35:03.489521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-59ea5f78-fb92-4c1c-8669-fd94759842ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:03.497763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:03.772067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060592ef-8d19-44e2-bad3-246ee0ed7c2d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:03.774398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-060592ef-8d19-44e2-bad3-246ee0ed7c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:03.782260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:35:03.788979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060592ef-8d19-44e2-bad3-246ee0ed7c2d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:03.792556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85bc5b-11d2-4cad-828b-5837b546f77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:03.793236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc5b-11d2-4cad-828b-5837b546f77f service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:03.793518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc5b-11d2-4cad-828b-5837b546f77f service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:03.793794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc5b-11d2-4cad-828b-5837b546f77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:03.802698 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85bc5b-11d2-4cad-828b-5837b546f77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:03.804154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85bc5b-11d2-4cad-828b-5837b546f77f service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:03.813584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 771/1539] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:35:13.483083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:35:13.809303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:39.226850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af2a79-528c-4a28-89f4-7000505e5532 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.228083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af2a79-528c-4a28-89f4-7000505e5532 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.228083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af2a79-528c-4a28-89f4-7000505e5532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.263366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d8af2a79-528c-4a28-89f4-7000505e5532 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.264604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d8af2a79-528c-4a28-89f4-7000505e5532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.276771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 769/1540] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.286463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442115-42d0-43f0-b450-2400a5e792e7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.287540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442115-42d0-43f0-b450-2400a5e792e7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.288050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442115-42d0-43f0-b450-2400a5e792e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.330101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cc442115-42d0-43f0-b450-2400a5e792e7 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.331608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cc442115-42d0-43f0-b450-2400a5e792e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.337394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f3c64-76cf-4358-9ca3-18a0197ac69a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.337688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f3c64-76cf-4358-9ca3-18a0197ac69a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.337973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f3c64-76cf-4358-9ca3-18a0197ac69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.344941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 772/1541] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.349808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc442115-42d0-43f0-b450-2400a5e792e7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.365350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc442115-42d0-43f0-b450-2400a5e792e7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.372207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.373133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.373453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a34f3c64-76cf-4358-9ca3-18a0197ac69a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.373777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.374212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.374674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a34f3c64-76cf-4358-9ca3-18a0197ac69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.375429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:39.375903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.377254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:39.377254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: warnings.warn(msg) May 27 09:36:39.377254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: May 27 09:36:39.378492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.394075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 770/1542] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:36:39.397300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 773/1543] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:36:39.405106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afa2d-8180-4074-a98d-016519700873 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.405397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afa2d-8180-4074-a98d-016519700873 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.405681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86afa2d-8180-4074-a98d-016519700873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.406565 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.419464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0e38c-0063-4231-9196-dbdad50b9dae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.433498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72a1c0-634b-4d00-901a-9c3255973d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.434990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a1c0-634b-4d00-901a-9c3255973d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.435481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a1c0-634b-4d00-901a-9c3255973d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.436108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a1c0-634b-4d00-901a-9c3255973d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.437186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72a1c0-634b-4d00-901a-9c3255973d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.439405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72a1c0-634b-4d00-901a-9c3255973d78 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.446779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b86afa2d-8180-4074-a98d-016519700873 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.448022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b86afa2d-8180-4074-a98d-016519700873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.466304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 771/1544] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.468030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a8a72-2070-451a-8135-ff3bd98ec287 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.468326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a8a72-2070-451a-8135-ff3bd98ec287 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.468612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a8a72-2070-451a-8135-ff3bd98ec287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.483102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 774/1545] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:36:39.484262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72a1c0-634b-4d00-901a-9c3255973d78 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.502314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-988a8a72-2070-451a-8135-ff3bd98ec287 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.503478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-988a8a72-2070-451a-8135-ff3bd98ec287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.564457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72a1c0-634b-4d00-901a-9c3255973d78 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.569799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.570474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.571298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.571580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.572307 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:39.572617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.574271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.587118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 775/1546] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:39.587773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.598964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3d19e-0178-4b34-90a6-6a6bded8958c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.603737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6a132-bd1b-40be-80e0-0b37da01bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.604405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6a132-bd1b-40be-80e0-0b37da01bda0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.604704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6a132-bd1b-40be-80e0-0b37da01bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.605007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6a132-bd1b-40be-80e0-0b37da01bda0 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.605694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6a132-bd1b-40be-80e0-0b37da01bda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.606201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 772/1547] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.607299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-71c6a132-bd1b-40be-80e0-0b37da01bda0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:39.607299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: warnings.warn(msg) May 27 09:36:39.607299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: May 27 09:36:39.608633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6a132-bd1b-40be-80e0-0b37da01bda0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.610307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a147d7-9a93-4d67-ab69-873b8921deea None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.610851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a147d7-9a93-4d67-ab69-873b8921deea None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.611392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a147d7-9a93-4d67-ab69-873b8921deea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.631232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b4a147d7-9a93-4d67-ab69-873b8921deea None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.632056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 776/1548] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:39.633707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b4a147d7-9a93-4d67-ab69-873b8921deea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.634123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd37a-c318-4210-bfdf-bec9142c9f10 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.634414 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd37a-c318-4210-bfdf-bec9142c9f10 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.634695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd37a-c318-4210-bfdf-bec9142c9f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.652644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 773/1549] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.653984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf622e3-10f8-4ada-a8ee-ce0f49c8df8e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.654116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-af5fd37a-c318-4210-bfdf-bec9142c9f10 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.654326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf622e3-10f8-4ada-a8ee-ce0f49c8df8e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.654608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf622e3-10f8-4ada-a8ee-ce0f49c8df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.655251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-af5fd37a-c318-4210-bfdf-bec9142c9f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.663909 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 777/1550] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.665143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad04ed-e273-4b63-bcb3-7a8ae8d59337 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.665428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad04ed-e273-4b63-bcb3-7a8ae8d59337 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.665700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad04ed-e273-4b63-bcb3-7a8ae8d59337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.673996 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3bf622e3-10f8-4ada-a8ee-ce0f49c8df8e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.675227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3bf622e3-10f8-4ada-a8ee-ce0f49c8df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.683259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b3ad04ed-e273-4b63-bcb3-7a8ae8d59337 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.683435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 774/1551] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.684206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf622e3-10f8-4ada-a8ee-ce0f49c8df8e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.684407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b3ad04ed-e273-4b63-bcb3-7a8ae8d59337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.694829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 778/1552] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.696613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a6922-2df4-48f8-83b8-8c2e2a33ad46 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.696922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a6922-2df4-48f8-83b8-8c2e2a33ad46 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.697197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a6922-2df4-48f8-83b8-8c2e2a33ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.698268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf622e3-10f8-4ada-a8ee-ce0f49c8df8e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.706184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f88048-05c8-49e2-96b6-94da1b357ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.706992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88048-05c8-49e2-96b6-94da1b357ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.707284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88048-05c8-49e2-96b6-94da1b357ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.707562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88048-05c8-49e2-96b6-94da1b357ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.708289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f88048-05c8-49e2-96b6-94da1b357ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.709354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING py.warnings [None req-b7f88048-05c8-49e2-96b6-94da1b357ecd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:39.709354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: warnings.warn(msg) May 27 09:36:39.709354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: May 27 09:36:39.710604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f88048-05c8-49e2-96b6-94da1b357ecd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.719626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d66a6922-2df4-48f8-83b8-8c2e2a33ad46 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.720930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d66a6922-2df4-48f8-83b8-8c2e2a33ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.729431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 779/1553] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.730610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a6922-2df4-48f8-83b8-8c2e2a33ad46 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.740147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a6922-2df4-48f8-83b8-8c2e2a33ad46 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.740787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 775/1554] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:39.744972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5de150-237a-44b8-a9a9-9ce16867a033 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.745327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5de150-237a-44b8-a9a9-9ce16867a033 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.745621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5de150-237a-44b8-a9a9-9ce16867a033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.763392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1b5de150-237a-44b8-a9a9-9ce16867a033 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.764605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1b5de150-237a-44b8-a9a9-9ce16867a033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.796600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbb115-2e1d-471e-8f19-19f78f21d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.797301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbb115-2e1d-471e-8f19-19f78f21d75a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.797587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbb115-2e1d-471e-8f19-19f78f21d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.797867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbb115-2e1d-471e-8f19-19f78f21d75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.798596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbb115-2e1d-471e-8f19-19f78f21d75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.800196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbb115-2e1d-471e-8f19-19f78f21d75a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.810319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 780/1555] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:39.811544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf20b39-d06d-4429-b5e0-2b56251a4f66 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.811828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf20b39-d06d-4429-b5e0-2b56251a4f66 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.812105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf20b39-d06d-4429-b5e0-2b56251a4f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.826275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 776/1556] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.827568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535be6-18ab-4ad4-a815-b8d82c5c85bf None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.827861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535be6-18ab-4ad4-a815-b8d82c5c85bf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.828145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535be6-18ab-4ad4-a815-b8d82c5c85bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.829902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-daf20b39-d06d-4429-b5e0-2b56251a4f66 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.831111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-daf20b39-d06d-4429-b5e0-2b56251a4f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.840199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 781/1557] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.841367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf6e9-7c4f-4627-bd40-6cfd63559f1b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.841661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf6e9-7c4f-4627-bd40-6cfd63559f1b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.842204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf6e9-7c4f-4627-bd40-6cfd63559f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.849219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:39.850958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0f535be6-18ab-4ad4-a815-b8d82c5c85bf None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.852271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0f535be6-18ab-4ad4-a815-b8d82c5c85bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.860809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 777/1558] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.861321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-aebdf6e9-7c4f-4627-bd40-6cfd63559f1b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.862084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bebb-443d-4b53-b4b0-1ca5ee5387ca None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.862373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bebb-443d-4b53-b4b0-1ca5ee5387ca None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.862475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-aebdf6e9-7c4f-4627-bd40-6cfd63559f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.862654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bebb-443d-4b53-b4b0-1ca5ee5387ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.871053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 782/1559] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.873702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdf6e9-7c4f-4627-bd40-6cfd63559f1b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.880756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f362bebb-443d-4b53-b4b0-1ca5ee5387ca None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.881973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f362bebb-443d-4b53-b4b0-1ca5ee5387ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.883335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdf6e9-7c4f-4627-bd40-6cfd63559f1b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.888709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.889406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.889690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.889966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.890696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:39.890915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 778/1560] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.891025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.891659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362bebb-443d-4b53-b4b0-1ca5ee5387ca None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.892784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.900818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362bebb-443d-4b53-b4b0-1ca5ee5387ca None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.905107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 783/1561] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:39.905957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.906324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc33a3-2d0b-468a-a0d8-e0e4d2570233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.907060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc33a3-2d0b-468a-a0d8-e0e4d2570233 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.907454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc33a3-2d0b-468a-a0d8-e0e4d2570233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.907830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc33a3-2d0b-468a-a0d8-e0e4d2570233 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.908619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc33a3-2d0b-468a-a0d8-e0e4d2570233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.910823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc33a3-2d0b-468a-a0d8-e0e4d2570233 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.916884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa76778-33b6-469c-b43d-0a66555577d0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.921611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352ac7b-d5ae-4ffe-abb9-1945bfb76e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.922218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ac7b-d5ae-4ffe-abb9-1945bfb76e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.922498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ac7b-d5ae-4ffe-abb9-1945bfb76e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.922772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ac7b-d5ae-4ffe-abb9-1945bfb76e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.923486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352ac7b-d5ae-4ffe-abb9-1945bfb76e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.925114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352ac7b-d5ae-4ffe-abb9-1945bfb76e40 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.933897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 779/1562] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:39.935196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3d26-2cf3-4c4c-8745-1892802f9661 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.935482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3d26-2cf3-4c4c-8745-1892802f9661 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.935762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3d26-2cf3-4c4c-8745-1892802f9661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.939295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 784/1563] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:39.940170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352ac7b-d5ae-4ffe-abb9-1945bfb76e40 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.950090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352ac7b-d5ae-4ffe-abb9-1945bfb76e40 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.953459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f6ed3d26-2cf3-4c4c-8745-1892802f9661 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:39.954599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.954754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f6ed3d26-2cf3-4c4c-8745-1892802f9661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:39.955231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.956966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.957403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.958260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:39.958580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.960272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.962882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 780/1564] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:39.963560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed3d26-2cf3-4c4c-8745-1892802f9661 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.980052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 785/1565] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:39.980229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed3d26-2cf3-4c4c-8745-1892802f9661 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.980332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:39.980431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.980431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.980431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.980431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.980782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:39.980782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.982274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.983287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f3f9-81a2-404a-99b1-544bc56d10e5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:39.984709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:39.988848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:39.989504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:39.989859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:39.990063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:39.990828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:39.991085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:39.993290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:39.995818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 781/1566] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:39.996752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.006403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880586e-e155-4bd4-a28c-380a00976e1c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.011566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.012233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.012373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 786/1567] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:40.012568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.012788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.013335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.013554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:40.013835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.015409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.025023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179ab25-330a-460f-b58e-411dc532434f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.027490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 782/1568] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:40.028281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.029672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb88b99-6a8f-4e74-9aab-88fbbaec3c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.030325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88b99-6a8f-4e74-9aab-88fbbaec3c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.030609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88b99-6a8f-4e74-9aab-88fbbaec3c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.030889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88b99-6a8f-4e74-9aab-88fbbaec3c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.031804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb88b99-6a8f-4e74-9aab-88fbbaec3c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.033759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb88b99-6a8f-4e74-9aab-88fbbaec3c58 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.039650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85d0e2-f513-463b-abee-496515818231 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.044203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f5a10-b96a-47fd-83be-93ccfc77006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.044867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f5a10-b96a-47fd-83be-93ccfc77006e admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.045151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f5a10-b96a-47fd-83be-93ccfc77006e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.045425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f5a10-b96a-47fd-83be-93ccfc77006e admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.046168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f5a10-b96a-47fd-83be-93ccfc77006e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.047737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f5a10-b96a-47fd-83be-93ccfc77006e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.058066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 783/1569] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.058823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f5a10-b96a-47fd-83be-93ccfc77006e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.063318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 787/1570] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.064463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb88b99-6a8f-4e74-9aab-88fbbaec3c58 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.068722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f5a10-b96a-47fd-83be-93ccfc77006e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.126270 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.126534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb88b99-6a8f-4e74-9aab-88fbbaec3c58 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.127163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.127450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.127733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] PATH_INFO: `/v3/projects/eaa5b5d1b2f8446ebedf6c5b17779493/users/9fe8260fecea43e09945df0520a0b996/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.131489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.132151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.132439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.132721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.134031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:40.134342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.135951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.142970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa5b5d1b2f8446ebedf6c5b17779493, user_id=9fe8260fecea43e09945df0520a0b996, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.144007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING py.warnings [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:40.144007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: warnings.warn(msg) May 27 09:36:40.144007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: May 27 09:36:40.145973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.147733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 788/1571] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:40.148511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.158519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab35d1-7e2c-4612-9fdf-db1c3e182a7a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.159860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 784/1572] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:40 2022] PUT /identity/v3/projects/eaa5b5d1b2f8446ebedf6c5b17779493/users/9fe8260fecea43e09945df0520a0b996/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:40.160471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.215127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8813-e2bd-4a10-98bb-2e48bd85daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.215847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8813-e2bd-4a10-98bb-2e48bd85daee admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.216125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8813-e2bd-4a10-98bb-2e48bd85daee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.216402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8813-e2bd-4a10-98bb-2e48bd85daee admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.217362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8813-e2bd-4a10-98bb-2e48bd85daee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.219258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8813-e2bd-4a10-98bb-2e48bd85daee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.225812 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727175-558b-40ce-bb94-2e24739bbc7c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.231480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b83c5-85a2-4975-af23-a9b44dfd1a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.232153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b83c5-85a2-4975-af23-a9b44dfd1a5f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.232407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b83c5-85a2-4975-af23-a9b44dfd1a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.232689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b83c5-85a2-4975-af23-a9b44dfd1a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.233540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b83c5-85a2-4975-af23-a9b44dfd1a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.235894 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b83c5-85a2-4975-af23-a9b44dfd1a5f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.245628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 789/1573] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.246351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8813-e2bd-4a10-98bb-2e48bd85daee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.252606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:40.265716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 785/1574] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.265716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b83c5-85a2-4975-af23-a9b44dfd1a5f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.308634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:40.318590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8813-e2bd-4a10-98bb-2e48bd85daee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.330643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b83c5-85a2-4975-af23-a9b44dfd1a5f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.335547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4917d36-c315-45f8-a210-2542667a0d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.336213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4917d36-c315-45f8-a210-2542667a0d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.336586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4917d36-c315-45f8-a210-2542667a0d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.336897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4917d36-c315-45f8-a210-2542667a0d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.337606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4917d36-c315-45f8-a210-2542667a0d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.339515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4917d36-c315-45f8-a210-2542667a0d45 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.366224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 786/1575] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.369805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4917d36-c315-45f8-a210-2542667a0d45 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.377748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954105-5785-4863-a5e9-6bfbf6ee4036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.378417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954105-5785-4863-a5e9-6bfbf6ee4036 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.378715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954105-5785-4863-a5e9-6bfbf6ee4036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.378977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954105-5785-4863-a5e9-6bfbf6ee4036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.379660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f954105-5785-4863-a5e9-6bfbf6ee4036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.381598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f954105-5785-4863-a5e9-6bfbf6ee4036 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.409475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 790/1576] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.409475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954105-5785-4863-a5e9-6bfbf6ee4036 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.433640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4917d36-c315-45f8-a210-2542667a0d45 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.468341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954105-5785-4863-a5e9-6bfbf6ee4036 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.472943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271313f-1a1b-4154-b437-928a1301a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.473610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271313f-1a1b-4154-b437-928a1301a0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.473892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271313f-1a1b-4154-b437-928a1301a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.474169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271313f-1a1b-4154-b437-928a1301a0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.474841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271313f-1a1b-4154-b437-928a1301a0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.476744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271313f-1a1b-4154-b437-928a1301a0f0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.489041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c82f8-9819-450a-85fe-8e9e744f5eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.489736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c82f8-9819-450a-85fe-8e9e744f5eba admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.490023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c82f8-9819-450a-85fe-8e9e744f5eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.490307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c82f8-9819-450a-85fe-8e9e744f5eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.491128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c82f8-9819-450a-85fe-8e9e744f5eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.492784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c82f8-9819-450a-85fe-8e9e744f5eba admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.499556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 791/1577] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.499556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271313f-1a1b-4154-b437-928a1301a0f0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.506257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 787/1578] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.506257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc65d6-df07-498b-a092-6c6828253eda None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.506257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc65d6-df07-498b-a092-6c6828253eda None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.506257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc65d6-df07-498b-a092-6c6828253eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.509126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271313f-1a1b-4154-b437-928a1301a0f0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.513624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b661-f584-4778-ab5f-53aad799d83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.514256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b661-f584-4778-ab5f-53aad799d83b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.514532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b661-f584-4778-ab5f-53aad799d83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.514807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b661-f584-4778-ab5f-53aad799d83b admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.515477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9b661-f584-4778-ab5f-53aad799d83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.517407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9b661-f584-4778-ab5f-53aad799d83b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.530306 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3afc65d6-df07-498b-a092-6c6828253eda None None] MFA Rules not processed for user `9fe8260fecea43e09945df0520a0b996`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:40.531509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3afc65d6-df07-498b-a092-6c6828253eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:40.542046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 792/1579] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.542844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b661-f584-4778-ab5f-53aad799d83b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.547941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:40.595385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:40.605445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 788/1580] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:40.605445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc65d6-df07-498b-a092-6c6828253eda None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.610773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b661-f584-4778-ab5f-53aad799d83b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.613207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc65d6-df07-498b-a092-6c6828253eda None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.615384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83079497-8705-4e6d-9226-0860caf2b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.616077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83079497-8705-4e6d-9226-0860caf2b8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.616363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83079497-8705-4e6d-9226-0860caf2b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.616635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83079497-8705-4e6d-9226-0860caf2b8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.617341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83079497-8705-4e6d-9226-0860caf2b8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.617808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794932-f5f7-4f11-ab23-779bb806abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.618688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794932-f5f7-4f11-ab23-779bb806abf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.619082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794932-f5f7-4f11-ab23-779bb806abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.619325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83079497-8705-4e6d-9226-0860caf2b8a2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.619476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794932-f5f7-4f11-ab23-779bb806abf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.620483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23794932-f5f7-4f11-ab23-779bb806abf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.623465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23794932-f5f7-4f11-ab23-779bb806abf4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.642645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 793/1581] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.642645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83079497-8705-4e6d-9226-0860caf2b8a2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.643092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 789/1582] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.643850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794932-f5f7-4f11-ab23-779bb806abf4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.651478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83079497-8705-4e6d-9226-0860caf2b8a2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.653755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794932-f5f7-4f11-ab23-779bb806abf4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.656255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b55f0-9285-4dfc-83ba-bd9bec99b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.656954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b55f0-9285-4dfc-83ba-bd9bec99b489 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.657252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b55f0-9285-4dfc-83ba-bd9bec99b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.657520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b55f0-9285-4dfc-83ba-bd9bec99b489 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.658206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b55f0-9285-4dfc-83ba-bd9bec99b489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.658344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05ccbc-9e93-4aa0-a4e0-50a6e627d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.658983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05ccbc-9e93-4aa0-a4e0-50a6e627d141 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.659267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05ccbc-9e93-4aa0-a4e0-50a6e627d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.659546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05ccbc-9e93-4aa0-a4e0-50a6e627d141 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.660141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b55f0-9285-4dfc-83ba-bd9bec99b489 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.660850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05ccbc-9e93-4aa0-a4e0-50a6e627d141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.662764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05ccbc-9e93-4aa0-a4e0-50a6e627d141 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.680759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 794/1583] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.681694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b55f0-9285-4dfc-83ba-bd9bec99b489 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.686986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 790/1584] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.686986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05ccbc-9e93-4aa0-a4e0-50a6e627d141 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.692436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b55f0-9285-4dfc-83ba-bd9bec99b489 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.694242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05ccbc-9e93-4aa0-a4e0-50a6e627d141 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.697238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac52e4-7f6d-48ab-835c-fba14ef7c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.697885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac52e4-7f6d-48ab-835c-fba14ef7c1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.698172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac52e4-7f6d-48ab-835c-fba14ef7c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.698451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac52e4-7f6d-48ab-835c-fba14ef7c1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.698798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293e878-e86b-4818-9762-52d97a93dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.699171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac52e4-7f6d-48ab-835c-fba14ef7c1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.699659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e878-e86b-4818-9762-52d97a93dcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.699941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e878-e86b-4818-9762-52d97a93dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.700219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e878-e86b-4818-9762-52d97a93dcc7 admin admin] PATH_INFO: `/v3/projects/a6cdccefdca74ab7b7e587e209e58ffb/users/43d9ae4fd922444e9f70fe79d4cacb5d/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.700773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac52e4-7f6d-48ab-835c-fba14ef7c1b8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.711952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 795/1585] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.712749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac52e4-7f6d-48ab-835c-fba14ef7c1b8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.720014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293e878-e86b-4818-9762-52d97a93dcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cdccefdca74ab7b7e587e209e58ffb, user_id=43d9ae4fd922444e9f70fe79d4cacb5d, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.722973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac52e4-7f6d-48ab-835c-fba14ef7c1b8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.723143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293e878-e86b-4818-9762-52d97a93dcc7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.729357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb182ac-5a17-4b49-8762-e49c6d25b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.730100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb182ac-5a17-4b49-8762-e49c6d25b860 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.730294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb182ac-5a17-4b49-8762-e49c6d25b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.730569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb182ac-5a17-4b49-8762-e49c6d25b860 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.731247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb182ac-5a17-4b49-8762-e49c6d25b860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.733261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb182ac-5a17-4b49-8762-e49c6d25b860 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.736461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 791/1586] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:40 2022] PUT /identity/v3/projects/a6cdccefdca74ab7b7e587e209e58ffb/users/43d9ae4fd922444e9f70fe79d4cacb5d/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:40.740926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293e878-e86b-4818-9762-52d97a93dcc7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.755676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 796/1587] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.755676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb182ac-5a17-4b49-8762-e49c6d25b860 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.762880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb182ac-5a17-4b49-8762-e49c6d25b860 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.804324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293e878-e86b-4818-9762-52d97a93dcc7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.808933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2e344-49eb-45d8-a29d-efac5e9f5445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.809586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2e344-49eb-45d8-a29d-efac5e9f5445 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.809862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2e344-49eb-45d8-a29d-efac5e9f5445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.810142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2e344-49eb-45d8-a29d-efac5e9f5445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.810817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2e344-49eb-45d8-a29d-efac5e9f5445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.812710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2e344-49eb-45d8-a29d-efac5e9f5445 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.821560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990215-7669-4f9d-b494-916ac38a4837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.822256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990215-7669-4f9d-b494-916ac38a4837 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.822539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990215-7669-4f9d-b494-916ac38a4837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.822851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990215-7669-4f9d-b494-916ac38a4837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.823571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990215-7669-4f9d-b494-916ac38a4837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.825233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990215-7669-4f9d-b494-916ac38a4837 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.838618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 797/1588] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.838618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990215-7669-4f9d-b494-916ac38a4837 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.841820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 792/1589] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:40.841820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2e344-49eb-45d8-a29d-efac5e9f5445 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.846970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990215-7669-4f9d-b494-916ac38a4837 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.887330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:40.902299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2e344-49eb-45d8-a29d-efac5e9f5445 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.903954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe10590-440b-4883-875d-a7cf91d9f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.904630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10590-440b-4883-875d-a7cf91d9f413 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.904949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10590-440b-4883-875d-a7cf91d9f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.905232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10590-440b-4883-875d-a7cf91d9f413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.905957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe10590-440b-4883-875d-a7cf91d9f413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.906772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85411b5-57de-4ee2-b19d-f0e01188f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.907430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85411b5-57de-4ee2-b19d-f0e01188f96f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.907618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe10590-440b-4883-875d-a7cf91d9f413 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.907719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85411b5-57de-4ee2-b19d-f0e01188f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.907977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85411b5-57de-4ee2-b19d-f0e01188f96f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.908691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85411b5-57de-4ee2-b19d-f0e01188f96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.910299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85411b5-57de-4ee2-b19d-f0e01188f96f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.918178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 798/1590] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.918977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe10590-440b-4883-875d-a7cf91d9f413 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.923574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 793/1591] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.923574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85411b5-57de-4ee2-b19d-f0e01188f96f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.929117 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe10590-440b-4883-875d-a7cf91d9f413 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.933051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85411b5-57de-4ee2-b19d-f0e01188f96f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.933807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc30c-62db-4851-a9bb-91ee26545d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.934464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc30c-62db-4851-a9bb-91ee26545d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.934750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc30c-62db-4851-a9bb-91ee26545d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.935030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc30c-62db-4851-a9bb-91ee26545d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.935797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc30c-62db-4851-a9bb-91ee26545d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.937393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc30c-62db-4851-a9bb-91ee26545d6d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.937617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a90c0-23bb-4bb1-9686-f67ea087f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.938254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a90c0-23bb-4bb1-9686-f67ea087f7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.938538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a90c0-23bb-4bb1-9686-f67ea087f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.938811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a90c0-23bb-4bb1-9686-f67ea087f7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.939519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a90c0-23bb-4bb1-9686-f67ea087f7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.941106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a90c0-23bb-4bb1-9686-f67ea087f7d1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.947739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 799/1592] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.949118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe591e-d7b7-48e4-9e5f-214156185934 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.949351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe591e-d7b7-48e4-9e5f-214156185934 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.949748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe591e-d7b7-48e4-9e5f-214156185934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.952174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 794/1593] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.952954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a90c0-23bb-4bb1-9686-f67ea087f7d1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.965208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a90c0-23bb-4bb1-9686-f67ea087f7d1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.969755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e0fe591e-d7b7-48e4-9e5f-214156185934 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:40.970127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eddb1-2b4f-4a02-920b-8b389854663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.970769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eddb1-2b4f-4a02-920b-8b389854663d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.970957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e0fe591e-d7b7-48e4-9e5f-214156185934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:40.971092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eddb1-2b4f-4a02-920b-8b389854663d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.971323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eddb1-2b4f-4a02-920b-8b389854663d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.972038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456eddb1-2b4f-4a02-920b-8b389854663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.973682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456eddb1-2b4f-4a02-920b-8b389854663d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:40.975784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:40.979570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 800/1594] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:40.980341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe591e-d7b7-48e4-9e5f-214156185934 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.986037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 795/1595] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:40.986857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eddb1-2b4f-4a02-920b-8b389854663d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:40.991382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe591e-d7b7-48e4-9e5f-214156185934 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.996146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb5290-b4e7-4a7e-8f94-7a6425e21a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:40.996805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb5290-b4e7-4a7e-8f94-7a6425e21a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:40.997120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb5290-b4e7-4a7e-8f94-7a6425e21a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:40.997395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb5290-b4e7-4a7e-8f94-7a6425e21a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:40.998122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb5290-b4e7-4a7e-8f94-7a6425e21a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:40.998740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eddb1-2b4f-4a02-920b-8b389854663d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:40.999752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb5290-b4e7-4a7e-8f94-7a6425e21a52 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.003496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc046c-f65c-4867-8c29-2a039d148811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.004152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc046c-f65c-4867-8c29-2a039d148811 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.004437 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc046c-f65c-4867-8c29-2a039d148811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.004718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc046c-f65c-4867-8c29-2a039d148811 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.005443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc046c-f65c-4867-8c29-2a039d148811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.007399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc046c-f65c-4867-8c29-2a039d148811 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.010393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 801/1596] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:41.011256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb5290-b4e7-4a7e-8f94-7a6425e21a52 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.021948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb5290-b4e7-4a7e-8f94-7a6425e21a52 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.027804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5def829-3b8e-4d0a-ae43-e69051072882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.028548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def829-3b8e-4d0a-ae43-e69051072882 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.028985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def829-3b8e-4d0a-ae43-e69051072882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.029451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def829-3b8e-4d0a-ae43-e69051072882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.030125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5def829-3b8e-4d0a-ae43-e69051072882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.033737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 796/1597] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:40 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:41.034427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5def829-3b8e-4d0a-ae43-e69051072882 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.034533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc046c-f65c-4867-8c29-2a039d148811 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.044183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc046c-f65c-4867-8c29-2a039d148811 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.044360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 802/1598] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:41.045342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5def829-3b8e-4d0a-ae43-e69051072882 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.051142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c97a-81c5-4ae5-a775-4f57bd37e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.051815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c97a-81c5-4ae5-a775-4f57bd37e2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.052101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c97a-81c5-4ae5-a775-4f57bd37e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.052382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c97a-81c5-4ae5-a775-4f57bd37e2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.053144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017c97a-81c5-4ae5-a775-4f57bd37e2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.054743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017c97a-81c5-4ae5-a775-4f57bd37e2cd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.056547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5def829-3b8e-4d0a-ae43-e69051072882 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.061244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601a43-fc1b-4e9e-9819-8381e9ee4cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.061893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601a43-fc1b-4e9e-9819-8381e9ee4cae admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.062180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601a43-fc1b-4e9e-9819-8381e9ee4cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.062457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7601a43-fc1b-4e9e-9819-8381e9ee4cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.063172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601a43-fc1b-4e9e-9819-8381e9ee4cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.064756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7601a43-fc1b-4e9e-9819-8381e9ee4cae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.064892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 797/1599] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:41.065613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c97a-81c5-4ae5-a775-4f57bd37e2cd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.078636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 803/1600] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:41.078636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601a43-fc1b-4e9e-9819-8381e9ee4cae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.078923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c97a-81c5-4ae5-a775-4f57bd37e2cd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.083210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403542-df54-4241-aa7f-1f7b595b06e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.084080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403542-df54-4241-aa7f-1f7b595b06e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.084359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403542-df54-4241-aa7f-1f7b595b06e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.084635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403542-df54-4241-aa7f-1f7b595b06e0 admin admin] PATH_INFO: `/v3/projects/b59db3bce231430ab0d2678c8dc24bf7/users/b9779a683e954facac0994a1866a0e84/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.086044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7601a43-fc1b-4e9e-9819-8381e9ee4cae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.091326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b9af-0a40-4b40-a4a9-8a8ba6d08a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.092238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b9af-0a40-4b40-a4a9-8a8ba6d08a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.092521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b9af-0a40-4b40-a4a9-8a8ba6d08a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.092795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b9af-0a40-4b40-a4a9-8a8ba6d08a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.093537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b9af-0a40-4b40-a4a9-8a8ba6d08a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.095159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b9af-0a40-4b40-a4a9-8a8ba6d08a39 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.100126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a403542-df54-4241-aa7f-1f7b595b06e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59db3bce231430ab0d2678c8dc24bf7, user_id=b9779a683e954facac0994a1866a0e84, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.102989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a403542-df54-4241-aa7f-1f7b595b06e0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.108304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 804/1601] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:41.109309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b9af-0a40-4b40-a4a9-8a8ba6d08a39 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.115758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 798/1602] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:41 2022] PUT /identity/v3/projects/b59db3bce231430ab0d2678c8dc24bf7/users/b9779a683e954facac0994a1866a0e84/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:41.116522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403542-df54-4241-aa7f-1f7b595b06e0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.165272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b9af-0a40-4b40-a4a9-8a8ba6d08a39 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.179414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403542-df54-4241-aa7f-1f7b595b06e0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.184441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6abf7-f5b7-46aa-b05b-557bfa24ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.185430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6abf7-f5b7-46aa-b05b-557bfa24ba43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.185718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6abf7-f5b7-46aa-b05b-557bfa24ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.186000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6abf7-f5b7-46aa-b05b-557bfa24ba43 admin admin] PATH_INFO: `/v3/projects/2adee140c52d4f3989c70924948a17e1/users/18ebfed707e3486e8d2ba522cef5ebbf/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.200583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6abf7-f5b7-46aa-b05b-557bfa24ba43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adee140c52d4f3989c70924948a17e1, user_id=18ebfed707e3486e8d2ba522cef5ebbf, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.203282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6abf7-f5b7-46aa-b05b-557bfa24ba43 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.214886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836cf5-95d5-41c3-9c7f-ec03313dcb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.215541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836cf5-95d5-41c3-9c7f-ec03313dcb98 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.215825 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836cf5-95d5-41c3-9c7f-ec03313dcb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.216108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836cf5-95d5-41c3-9c7f-ec03313dcb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.217487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 799/1603] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:41 2022] PUT /identity/v3/projects/2adee140c52d4f3989c70924948a17e1/users/18ebfed707e3486e8d2ba522cef5ebbf/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:41.218353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6abf7-f5b7-46aa-b05b-557bfa24ba43 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.225975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836cf5-95d5-41c3-9c7f-ec03313dcb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.227506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836cf5-95d5-41c3-9c7f-ec03313dcb98 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.237381 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 805/1604] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:41.238148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836cf5-95d5-41c3-9c7f-ec03313dcb98 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.246995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836cf5-95d5-41c3-9c7f-ec03313dcb98 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.281280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6abf7-f5b7-46aa-b05b-557bfa24ba43 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.285172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:41.287109 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073e0e1-f6e6-4f75-a6df-8b767724134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.287787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073e0e1-f6e6-4f75-a6df-8b767724134e admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.288125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073e0e1-f6e6-4f75-a6df-8b767724134e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.288339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073e0e1-f6e6-4f75-a6df-8b767724134e admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.289106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073e0e1-f6e6-4f75-a6df-8b767724134e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.294741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073e0e1-f6e6-4f75-a6df-8b767724134e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.307072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 800/1605] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:41.308073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073e0e1-f6e6-4f75-a6df-8b767724134e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.316627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2a16-1828-4cb5-9f80-4ae6f29f1b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.317822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2a16-1828-4cb5-9f80-4ae6f29f1b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.318173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2a16-1828-4cb5-9f80-4ae6f29f1b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.318463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2a16-1828-4cb5-9f80-4ae6f29f1b26 admin admin] PATH_INFO: `/v3/projects/a44df5252ff049338e53726fe7b7cfc0/users/1a3ca370feb4457dbadc476e348ac9ff/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.319117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073e0e1-f6e6-4f75-a6df-8b767724134e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.325608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cc5d3-306e-4c50-bfd3-3704d112d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.326669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cc5d3-306e-4c50-bfd3-3704d112d625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.327054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cc5d3-306e-4c50-bfd3-3704d112d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.327447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cc5d3-306e-4c50-bfd3-3704d112d625 admin admin] PATH_INFO: `/v3/projects/026b6a985b404b949ecba2f0294628fc/users/3b1526b12e3640cfb8ccbdc7aca7162a/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.337348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d2a16-1828-4cb5-9f80-4ae6f29f1b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44df5252ff049338e53726fe7b7cfc0, user_id=1a3ca370feb4457dbadc476e348ac9ff, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.340134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d2a16-1828-4cb5-9f80-4ae6f29f1b26 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.345787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cc5d3-306e-4c50-bfd3-3704d112d625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026b6a985b404b949ecba2f0294628fc, user_id=3b1526b12e3640cfb8ccbdc7aca7162a, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.348530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cc5d3-306e-4c50-bfd3-3704d112d625 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.355693 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 806/1606] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:41 2022] PUT /identity/v3/projects/a44df5252ff049338e53726fe7b7cfc0/users/1a3ca370feb4457dbadc476e348ac9ff/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:41.356656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2a16-1828-4cb5-9f80-4ae6f29f1b26 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.362796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:41.370289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 801/1607] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:41 2022] PUT /identity/v3/projects/026b6a985b404b949ecba2f0294628fc/users/3b1526b12e3640cfb8ccbdc7aca7162a/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:41.381089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cc5d3-306e-4c50-bfd3-3704d112d625 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.451474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2a16-1828-4cb5-9f80-4ae6f29f1b26 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.462472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cc5d3-306e-4c50-bfd3-3704d112d625 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.468443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ecf4d-8de1-4859-87ee-cef2115cc88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.469535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ecf4d-8de1-4859-87ee-cef2115cc88a admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.469892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ecf4d-8de1-4859-87ee-cef2115cc88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.470247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ecf4d-8de1-4859-87ee-cef2115cc88a admin admin] PATH_INFO: `/v3/projects/08faaf7af9454fe69f51479199c952a6/users/602479d610384aa7876d303e8c606272/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.486566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ecf4d-8de1-4859-87ee-cef2115cc88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08faaf7af9454fe69f51479199c952a6, user_id=602479d610384aa7876d303e8c606272, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.489503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ecf4d-8de1-4859-87ee-cef2115cc88a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.510791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 802/1608] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:41 2022] PUT /identity/v3/projects/08faaf7af9454fe69f51479199c952a6/users/602479d610384aa7876d303e8c606272/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:41.512629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ac9f-a5ba-419c-978a-108b3747c836 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.513134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ac9f-a5ba-419c-978a-108b3747c836 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.513802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ac9f-a5ba-419c-978a-108b3747c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.523374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5af1d-9428-4668-a974-19b90a57c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.524245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5af1d-9428-4668-a974-19b90a57c1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.524522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5af1d-9428-4668-a974-19b90a57c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.524797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5af1d-9428-4668-a974-19b90a57c1e5 admin admin] PATH_INFO: `/v3/projects/75b3548a4fad4430b7e035eb32e46f2f/users/e47f27ecdea94a38872b1e47c4bdbc87/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.534718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0d40ac9f-a5ba-419c-978a-108b3747c836 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:41.536089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0d40ac9f-a5ba-419c-978a-108b3747c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:41.540404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5af1d-9428-4668-a974-19b90a57c1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b3548a4fad4430b7e035eb32e46f2f, user_id=e47f27ecdea94a38872b1e47c4bdbc87, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.543275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5af1d-9428-4668-a974-19b90a57c1e5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.559474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 807/1609] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:41 2022] PUT /identity/v3/projects/75b3548a4fad4430b7e035eb32e46f2f/users/e47f27ecdea94a38872b1e47c4bdbc87/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:41.570773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688efb-be9d-41f5-bbf3-4957ea5ee65d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.571802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688efb-be9d-41f5-bbf3-4957ea5ee65d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.572087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688efb-be9d-41f5-bbf3-4957ea5ee65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.589620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-93688efb-be9d-41f5-bbf3-4957ea5ee65d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:41.590855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-93688efb-be9d-41f5-bbf3-4957ea5ee65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:41.612661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 803/1610] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:41.614017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ac9f-a5ba-419c-978a-108b3747c836 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.627345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ac9f-a5ba-419c-978a-108b3747c836 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.657132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:41.685172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 808/1611] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:41.687906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794684-d75d-470c-bdc0-4d7f51360495 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.688398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794684-d75d-470c-bdc0-4d7f51360495 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.689102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794684-d75d-470c-bdc0-4d7f51360495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.710851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e601f-a138-47cc-90d6-287dfe0b3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.711912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e601f-a138-47cc-90d6-287dfe0b3a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.712503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e601f-a138-47cc-90d6-287dfe0b3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.712806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e601f-a138-47cc-90d6-287dfe0b3a48 admin admin] PATH_INFO: `/v3/projects/c1729027b45740b7b539d9a060164cbd/users/276686a8f57f4dc4a15f4446ada34311/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.712979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-58794684-d75d-470c-bdc0-4d7f51360495 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:41.714970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-58794684-d75d-470c-bdc0-4d7f51360495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:41.725555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 809/1612] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:41.727719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de0d6-6d80-4e6b-872f-0d02f236dbf1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.728325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de0d6-6d80-4e6b-872f-0d02f236dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.728711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de0d6-6d80-4e6b-872f-0d02f236dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.739075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e601f-a138-47cc-90d6-287dfe0b3a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1729027b45740b7b539d9a060164cbd, user_id=276686a8f57f4dc4a15f4446ada34311, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:41.742118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e601f-a138-47cc-90d6-287dfe0b3a48 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:41.757050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 804/1613] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:41 2022] PUT /identity/v3/projects/c1729027b45740b7b539d9a060164cbd/users/276686a8f57f4dc4a15f4446ada34311/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:41.758521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781bf62-d4cd-42fb-bbb9-7f60ab1daa37 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.758811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781bf62-d4cd-42fb-bbb9-7f60ab1daa37 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.759091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781bf62-d4cd-42fb-bbb9-7f60ab1daa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.763711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ab9de0d6-6d80-4e6b-872f-0d02f236dbf1 None None] MFA Rules not processed for user `3b1526b12e3640cfb8ccbdc7aca7162a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:41.765019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ab9de0d6-6d80-4e6b-872f-0d02f236dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:41.771189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:41.790411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4781bf62-d4cd-42fb-bbb9-7f60ab1daa37 None None] MFA Rules not processed for user `602479d610384aa7876d303e8c606272`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:41.792478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4781bf62-d4cd-42fb-bbb9-7f60ab1daa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:41.844798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 810/1614] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:41.846190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6177a-f1b5-4c0e-8bb4-41b9287a5791 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.846418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6177a-f1b5-4c0e-8bb4-41b9287a5791 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.846699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6177a-f1b5-4c0e-8bb4-41b9287a5791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.864394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 805/1615] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:41.870289 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781bf62-d4cd-42fb-bbb9-7f60ab1daa37 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:41.871848 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4781bf62-d4cd-42fb-bbb9-7f60ab1daa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:41.892740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f6c6177a-f1b5-4c0e-8bb4-41b9287a5791 None None] MFA Rules not processed for user `e47f27ecdea94a38872b1e47c4bdbc87`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:41.894280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f6c6177a-f1b5-4c0e-8bb4-41b9287a5791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:41.952054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781bf62-d4cd-42fb-bbb9-7f60ab1daa37 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:41.964698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2f008-d5a1-4bf1-9b2b-701219269734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:41.965532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f008-d5a1-4bf1-9b2b-701219269734 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:41.965816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f008-d5a1-4bf1-9b2b-701219269734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:41.966569 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f008-d5a1-4bf1-9b2b-701219269734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:41.995262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 811/1616] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:41.995262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6177a-f1b5-4c0e-8bb4-41b9287a5791 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.015519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6177a-f1b5-4c0e-8bb4-41b9287a5791 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.024326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6aacf-a4b1-4d30-ac55-a783d2bab90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.025157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6aacf-a4b1-4d30-ac55-a783d2bab90a service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.026885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6aacf-a4b1-4d30-ac55-a783d2bab90a service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.027316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6aacf-a4b1-4d30-ac55-a783d2bab90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.083513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2f008-d5a1-4bf1-9b2b-701219269734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.085695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2f008-d5a1-4bf1-9b2b-701219269734 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.106774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 806/1617] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:42.107511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2f008-d5a1-4bf1-9b2b-701219269734 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.120748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2f008-d5a1-4bf1-9b2b-701219269734 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.121213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6aacf-a4b1-4d30-ac55-a783d2bab90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.122784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6aacf-a4b1-4d30-ac55-a783d2bab90a service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.127324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:42.132303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123e35e-4e98-4f72-a6a1-f9eaa6ecac26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.133285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123e35e-4e98-4f72-a6a1-f9eaa6ecac26 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.134064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123e35e-4e98-4f72-a6a1-f9eaa6ecac26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.134665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123e35e-4e98-4f72-a6a1-f9eaa6ecac26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.135752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 812/1618] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:42.136753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6aacf-a4b1-4d30-ac55-a783d2bab90a service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.146902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123e35e-4e98-4f72-a6a1-f9eaa6ecac26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.147691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6aacf-a4b1-4d30-ac55-a783d2bab90a service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.149483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123e35e-4e98-4f72-a6a1-f9eaa6ecac26 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.154018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1cf2f-2177-48d1-bb41-9111115067f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.154834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1cf2f-2177-48d1-bb41-9111115067f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.155228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1cf2f-2177-48d1-bb41-9111115067f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.155611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1cf2f-2177-48d1-bb41-9111115067f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.156501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1cf2f-2177-48d1-bb41-9111115067f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.158311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1cf2f-2177-48d1-bb41-9111115067f9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.165290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 807/1619] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:42.166724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123e35e-4e98-4f72-a6a1-f9eaa6ecac26 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.175068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 813/1620] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:42.176722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0bfd-f0e8-480f-962b-66d0e99a7f5c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.177161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0bfd-f0e8-480f-962b-66d0e99a7f5c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.177578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0bfd-f0e8-480f-962b-66d0e99a7f5c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.178973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123e35e-4e98-4f72-a6a1-f9eaa6ecac26 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.179545 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 814/1621] 10.222.0.79 () {54 vars in 961 bytes} [Fri May 27 09:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:42.181047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95715af1-4818-44e1-a29f-6dbd9442299d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.181538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95715af1-4818-44e1-a29f-6dbd9442299d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.181924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95715af1-4818-44e1-a29f-6dbd9442299d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.183559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 815/1622] 10.222.0.79 () {54 vars in 961 bytes} [Fri May 27 09:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:42.184326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95715af1-4818-44e1-a29f-6dbd9442299d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.193582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043012-5453-4558-bf39-0f5cbc1367ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.194261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043012-5453-4558-bf39-0f5cbc1367ee admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.194585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043012-5453-4558-bf39-0f5cbc1367ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.194862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043012-5453-4558-bf39-0f5cbc1367ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.195557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca043012-5453-4558-bf39-0f5cbc1367ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.197829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca043012-5453-4558-bf39-0f5cbc1367ee admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.199412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95715af1-4818-44e1-a29f-6dbd9442299d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.204351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4526c-91c8-4d75-b866-13f315b81da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.205487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4526c-91c8-4d75-b866-13f315b81da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.205906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4526c-91c8-4d75-b866-13f315b81da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.206618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4526c-91c8-4d75-b866-13f315b81da4 admin admin] PATH_INFO: `/v3/projects/c1729027b45740b7b539d9a060164cbd/users/276686a8f57f4dc4a15f4446ada34311/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.208739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4526c-91c8-4d75-b866-13f315b81da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1729027b45740b7b539d9a060164cbd, user_id=276686a8f57f4dc4a15f4446ada34311, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.212164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4526c-91c8-4d75-b866-13f315b81da4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.226138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 816/1623] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:42 2022] PUT /identity/v3/projects/c1729027b45740b7b539d9a060164cbd/users/276686a8f57f4dc4a15f4446ada34311/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:42.228235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782fa20-6cf0-49be-b238-053cfddad15b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.228753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782fa20-6cf0-49be-b238-053cfddad15b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.229198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782fa20-6cf0-49be-b238-053cfddad15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.245116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 808/1624] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:42 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:42.246447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce713ee-8682-4bc7-b1a6-5fd100276f13 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.246735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce713ee-8682-4bc7-b1a6-5fd100276f13 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.247010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce713ee-8682-4bc7-b1a6-5fd100276f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.266430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f782fa20-6cf0-49be-b238-053cfddad15b None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:42.270011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f782fa20-6cf0-49be-b238-053cfddad15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:42.288929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7ce713ee-8682-4bc7-b1a6-5fd100276f13 None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:42.291800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7ce713ee-8682-4bc7-b1a6-5fd100276f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:42.309048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:42.376570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 817/1625] 10.222.0.79 () {58 vars in 1058 bytes} [Fri May 27 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:42.378837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5ce8-3ccd-45ef-bf72-fdff0a5069d1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.379227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5ce8-3ccd-45ef-bf72-fdff0a5069d1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.379684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5ce8-3ccd-45ef-bf72-fdff0a5069d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.411509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 809/1626] 10.222.0.79 () {58 vars in 1058 bytes} [Fri May 27 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:42.413153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce713ee-8682-4bc7-b1a6-5fd100276f13 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.417069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dc6d5ce8-3ccd-45ef-bf72-fdff0a5069d1 None None] MFA Rules not processed for user `276686a8f57f4dc4a15f4446ada34311`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:42.419068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dc6d5ce8-3ccd-45ef-bf72-fdff0a5069d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:42.508738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce713ee-8682-4bc7-b1a6-5fd100276f13 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.512937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 818/1627] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:42.513920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5ce8-3ccd-45ef-bf72-fdff0a5069d1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.516450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59ba0-33e8-4a1d-95f4-f92dccfa965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.517561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59ba0-33e8-4a1d-95f4-f92dccfa965d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.518024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59ba0-33e8-4a1d-95f4-f92dccfa965d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.518462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59ba0-33e8-4a1d-95f4-f92dccfa965d admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.519320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f59ba0-33e8-4a1d-95f4-f92dccfa965d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.523209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f59ba0-33e8-4a1d-95f4-f92dccfa965d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.542679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5ce8-3ccd-45ef-bf72-fdff0a5069d1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.550051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4512baa-9e0d-4136-8be4-42375ab8a10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.551055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4512baa-9e0d-4136-8be4-42375ab8a10b service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.551705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4512baa-9e0d-4136-8be4-42375ab8a10b service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.552206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4512baa-9e0d-4136-8be4-42375ab8a10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.554972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 810/1628] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:42 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:42.556118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59ba0-33e8-4a1d-95f4-f92dccfa965d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.596147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59ba0-33e8-4a1d-95f4-f92dccfa965d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.605064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928e324-d0cc-43fe-9b59-d049c796d106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.606278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928e324-d0cc-43fe-9b59-d049c796d106 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.606578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928e324-d0cc-43fe-9b59-d049c796d106 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.606865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928e324-d0cc-43fe-9b59-d049c796d106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.632886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:42.661406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4512baa-9e0d-4136-8be4-42375ab8a10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.666961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4512baa-9e0d-4136-8be4-42375ab8a10b service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.686025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928e324-d0cc-43fe-9b59-d049c796d106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.688188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928e324-d0cc-43fe-9b59-d049c796d106 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.693643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 819/1629] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:42.697541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4512baa-9e0d-4136-8be4-42375ab8a10b service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.719562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 811/1630] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:42.722049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928e324-d0cc-43fe-9b59-d049c796d106 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.748904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928e324-d0cc-43fe-9b59-d049c796d106 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.764646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5684-5723-4ec2-96f3-f6c8c81c3bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.765230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5684-5723-4ec2-96f3-f6c8c81c3bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.765524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5684-5723-4ec2-96f3-f6c8c81c3bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.769516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5684-5723-4ec2-96f3-f6c8c81c3bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.774573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5684-5723-4ec2-96f3-f6c8c81c3bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.780525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5684-5723-4ec2-96f3-f6c8c81c3bb2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.813303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 812/1631] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:42.816415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5684-5723-4ec2-96f3-f6c8c81c3bb2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.819619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4512baa-9e0d-4136-8be4-42375ab8a10b service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.828529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc2c7f-c53a-489c-9226-cb37675a8198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.830583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2c7f-c53a-489c-9226-cb37675a8198 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.830873 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2c7f-c53a-489c-9226-cb37675a8198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.831609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2c7f-c53a-489c-9226-cb37675a8198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.841536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5684-5723-4ec2-96f3-f6c8c81c3bb2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:42.854072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc2c7f-c53a-489c-9226-cb37675a8198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.855676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeeda4f-9a7e-48d5-a2e5-855ad3e5cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:42.857486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeda4f-9a7e-48d5-a2e5-855ad3e5cddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:42.857782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeda4f-9a7e-48d5-a2e5-855ad3e5cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:42.858071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeda4f-9a7e-48d5-a2e5-855ad3e5cddd admin admin] PATH_INFO: `/v3/projects/7f5685a945bb4be8a9bec779e374f9ea/users/ed347271276440e097f3de300aae5313/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:42.858419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc2c7f-c53a-489c-9226-cb37675a8198 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.904846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 820/1632] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:42.905709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeeda4f-9a7e-48d5-a2e5-855ad3e5cddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5685a945bb4be8a9bec779e374f9ea, user_id=ed347271276440e097f3de300aae5313, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:42.913655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeeda4f-9a7e-48d5-a2e5-855ad3e5cddd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:42.920774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:42.946595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 813/1633] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:42 2022] PUT /identity/v3/projects/7f5685a945bb4be8a9bec779e374f9ea/users/ed347271276440e097f3de300aae5313/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:42.949545 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc2c7f-c53a-489c-9226-cb37675a8198 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:42.968097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc2c7f-c53a-489c-9226-cb37675a8198 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.078442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edea04-10ec-452f-8365-ce064f7b0aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.079653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edea04-10ec-452f-8365-ce064f7b0aac admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.080159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edea04-10ec-452f-8365-ce064f7b0aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.081121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edea04-10ec-452f-8365-ce064f7b0aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.082459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edea04-10ec-452f-8365-ce064f7b0aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.085544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edea04-10ec-452f-8365-ce064f7b0aac admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.114679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 821/1634] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:43.114808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeeda4f-9a7e-48d5-a2e5-855ad3e5cddd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.133017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeeda4f-9a7e-48d5-a2e5-855ad3e5cddd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.144595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a8fe9-9716-4d73-a8e4-f00a487d5a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.149646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8fe9-9716-4d73-a8e4-f00a487d5a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.149938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8fe9-9716-4d73-a8e4-f00a487d5a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.150226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8fe9-9716-4d73-a8e4-f00a487d5a6e admin admin] PATH_INFO: `/v3/projects/7f5685a945bb4be8a9bec779e374f9ea/users/ed347271276440e097f3de300aae5313/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.153089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a8fe9-9716-4d73-a8e4-f00a487d5a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5685a945bb4be8a9bec779e374f9ea, user_id=ed347271276440e097f3de300aae5313, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.158531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a8fe9-9716-4d73-a8e4-f00a487d5a6e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.193890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 814/1635] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:43 2022] PUT /identity/v3/projects/7f5685a945bb4be8a9bec779e374f9ea/users/ed347271276440e097f3de300aae5313/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:43.208012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409687-b33b-4d09-af1a-1325c73a3cf5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.208306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409687-b33b-4d09-af1a-1325c73a3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.208586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409687-b33b-4d09-af1a-1325c73a3cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.271922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa901-3240-4a08-8a06-fae2eaf49d55 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.272339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa901-3240-4a08-8a06-fae2eaf49d55 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.272935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa901-3240-4a08-8a06-fae2eaf49d55 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.275309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 815/1636] 10.222.0.79 () {54 vars in 912 bytes} [Fri May 27 09:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:36:43.285413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9abba-335a-42a9-a0f0-1743c0fbd617 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.286264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9abba-335a-42a9-a0f0-1743c0fbd617 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.286587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9abba-335a-42a9-a0f0-1743c0fbd617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.313578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-77409687-b33b-4d09-af1a-1325c73a3cf5 None None] MFA Rules not processed for user `ed347271276440e097f3de300aae5313`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.315141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-77409687-b33b-4d09-af1a-1325c73a3cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.321817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-04b9abba-335a-42a9-a0f0-1743c0fbd617 None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.323757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-04b9abba-335a-42a9-a0f0-1743c0fbd617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.487279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 822/1637] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:43.500665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77409687-b33b-4d09-af1a-1325c73a3cf5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.529906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:43.552333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 816/1638] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:36:43.554313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f9499-a5fd-4f17-8669-2f428de32b12 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.561420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f9499-a5fd-4f17-8669-2f428de32b12 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.561420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f9499-a5fd-4f17-8669-2f428de32b12 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.562111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 817/1639] 10.222.0.79 () {54 vars in 912 bytes} [Fri May 27 09:36:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:43.568963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f9499-a5fd-4f17-8669-2f428de32b12 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.609500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77409687-b33b-4d09-af1a-1325c73a3cf5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.622272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808f20a-bca6-4891-9a83-172d8ca66550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.623016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808f20a-bca6-4891-9a83-172d8ca66550 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.623310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808f20a-bca6-4891-9a83-172d8ca66550 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.623595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808f20a-bca6-4891-9a83-172d8ca66550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.646962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808f20a-bca6-4891-9a83-172d8ca66550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.650977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808f20a-bca6-4891-9a83-172d8ca66550 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.685112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 823/1640] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:36:43.689818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820123-c6e2-4520-a43a-912502a3007c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.690485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820123-c6e2-4520-a43a-912502a3007c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.690779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820123-c6e2-4520-a43a-912502a3007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.726311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f9499-a5fd-4f17-8669-2f428de32b12 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.737138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e47d90-ba04-4951-8720-6f9414d04e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.737923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e47d90-ba04-4951-8720-6f9414d04e71 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.739209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d4820123-c6e2-4520-a43a-912502a3007c None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:43.740952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e47d90-ba04-4951-8720-6f9414d04e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.741342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e47d90-ba04-4951-8720-6f9414d04e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:43.742396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d4820123-c6e2-4520-a43a-912502a3007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:43.765640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e47d90-ba04-4951-8720-6f9414d04e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:43.767653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e47d90-ba04-4951-8720-6f9414d04e71 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:43.784131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 824/1641] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:43.785514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 818/1642] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:43.927973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4820123-c6e2-4520-a43a-912502a3007c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:43.981897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4820123-c6e2-4520-a43a-912502a3007c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:43.989756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120dbd0-4a50-4077-95f5-2489c4e9ae16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:43.993591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120dbd0-4a50-4077-95f5-2489c4e9ae16 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:43.993880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120dbd0-4a50-4077-95f5-2489c4e9ae16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:43.994166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120dbd0-4a50-4077-95f5-2489c4e9ae16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.025020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120dbd0-4a50-4077-95f5-2489c4e9ae16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.029583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120dbd0-4a50-4077-95f5-2489c4e9ae16 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.085260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 825/1643] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:44.404911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e47d90-ba04-4951-8720-6f9414d04e71 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.503794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120dbd0-4a50-4077-95f5-2489c4e9ae16 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:44.624423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e47d90-ba04-4951-8720-6f9414d04e71 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.636614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.638995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.641463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.642161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] PATH_INFO: `/v3/users/9fe8260fecea43e09945df0520a0b996` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.644013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe8260fecea43e09945df0520a0b996)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.645987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: WARNING py.warnings [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:44.645987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: warnings.warn(msg) May 27 09:36:44.645987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: May 27 09:36:44.647942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120dbd0-4a50-4077-95f5-2489c4e9ae16 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:44.648968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.681505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:44.682552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.682834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.683759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] PATH_INFO: `/v3/users/602479d610384aa7876d303e8c606272` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.690405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=602479d610384aa7876d303e8c606272)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:44.692441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:44.701792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:44.804732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe8260fecea43e09945df0520a0b996'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.853005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602479d610384aa7876d303e8c606272'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.868414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe8260fecea43e09945df0520a0b996'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.874391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe8260fecea43e09945df0520a0b996'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.881293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602479d610384aa7876d303e8c606272'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.901252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602479d610384aa7876d303e8c606272'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.902389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602479d610384aa7876d303e8c606272'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.904236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b3025de-31ec-4c2b-b139-7c8ee9a888e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602479d610384aa7876d303e8c606272'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.917452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe8260fecea43e09945df0520a0b996'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.920311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6a4d7f93-a489-4400-a7a4-8a8ae3f72737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe8260fecea43e09945df0520a0b996'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:44.948682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 826/1644] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:44 2022] DELETE /identity/v3/users/602479d610384aa7876d303e8c606272 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:44.952079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea3851-b9ef-4547-82a2-4bc59c8722d3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.952387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea3851-b9ef-4547-82a2-4bc59c8722d3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.953852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea3851-b9ef-4547-82a2-4bc59c8722d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:44.983871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 819/1645] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:44 2022] DELETE /identity/v3/users/9fe8260fecea43e09945df0520a0b996 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:44.985021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1890249-c24a-4f9b-a280-af2f49e02021 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:44.991058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1890249-c24a-4f9b-a280-af2f49e02021 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:44.991058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1890249-c24a-4f9b-a280-af2f49e02021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.049851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b1890249-c24a-4f9b-a280-af2f49e02021 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:45.051922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b0ea3851-b9ef-4547-82a2-4bc59c8722d3 None None] MFA Rules not processed for user `18ebfed707e3486e8d2ba522cef5ebbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:45.056970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b1890249-c24a-4f9b-a280-af2f49e02021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.058189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b0ea3851-b9ef-4547-82a2-4bc59c8722d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.067992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:45.226628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 820/1646] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:45.228861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78f29-86c3-4d63-bd4c-9d4c8d7619b8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.229154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78f29-86c3-4d63-bd4c-9d4c8d7619b8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.229494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e78f29-86c3-4d63-bd4c-9d4c8d7619b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.257677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-64e78f29-86c3-4d63-bd4c-9d4c8d7619b8 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:45.259872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-64e78f29-86c3-4d63-bd4c-9d4c8d7619b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.270654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 821/1647] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:45.272492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e78f29-86c3-4d63-bd4c-9d4c8d7619b8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.283345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-64e78f29-86c3-4d63-bd4c-9d4c8d7619b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.286207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 827/1648] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:45.287227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea3851-b9ef-4547-82a2-4bc59c8722d3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.291385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b0ea3851-b9ef-4547-82a2-4bc59c8722d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.310858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e78f29-86c3-4d63-bd4c-9d4c8d7619b8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.409722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.409722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.409722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.409722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] PATH_INFO: `/v3/users/3b1526b12e3640cfb8ccbdc7aca7162a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.411675 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1526b12e3640cfb8ccbdc7aca7162a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.426000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.472961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea3851-b9ef-4547-82a2-4bc59c8722d3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.482046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26202c7a-aa5a-435b-a102-f7b9f63bfb4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.484306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26202c7a-aa5a-435b-a102-f7b9f63bfb4c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.486877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26202c7a-aa5a-435b-a102-f7b9f63bfb4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.486877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26202c7a-aa5a-435b-a102-f7b9f63bfb4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.510391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26202c7a-aa5a-435b-a102-f7b9f63bfb4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.514522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26202c7a-aa5a-435b-a102-f7b9f63bfb4c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.523014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1526b12e3640cfb8ccbdc7aca7162a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:45.542749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1526b12e3640cfb8ccbdc7aca7162a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:45.543664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1526b12e3640cfb8ccbdc7aca7162a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:45.546213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 828/1649] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:45.546213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26202c7a-aa5a-435b-a102-f7b9f63bfb4c service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:45.561031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1526b12e3640cfb8ccbdc7aca7162a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:45.561862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0b3fcf66-6abe-45c6-99b0-2151ec5bafb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1526b12e3640cfb8ccbdc7aca7162a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:45.567012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26202c7a-aa5a-435b-a102-f7b9f63bfb4c service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:45.579814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b154b5-8db1-43a8-8ed6-d3d39783675f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:45.580658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b154b5-8db1-43a8-8ed6-d3d39783675f service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.581038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b154b5-8db1-43a8-8ed6-d3d39783675f service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.581233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 822/1650] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:45 2022] DELETE /identity/v3/users/3b1526b12e3640cfb8ccbdc7aca7162a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:45.582808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f26d-a610-4288-b84c-ef788b7d8a5b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.583119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f26d-a610-4288-b84c-ef788b7d8a5b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.583441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f26d-a610-4288-b84c-ef788b7d8a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.584345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b154b5-8db1-43a8-8ed6-d3d39783675f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.591000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f5b154b5-8db1-43a8-8ed6-d3d39783675f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.592677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:45.626195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b154b5-8db1-43a8-8ed6-d3d39783675f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:45.627861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b154b5-8db1-43a8-8ed6-d3d39783675f service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:45.633776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b358f26d-a610-4288-b84c-ef788b7d8a5b None None] MFA Rules not processed for user `18ebfed707e3486e8d2ba522cef5ebbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:45.640861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b358f26d-a610-4288-b84c-ef788b7d8a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.654296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 829/1651] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:45.657458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371d8d-e829-46c3-a57d-43a2d47e3ea9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.658099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371d8d-e829-46c3-a57d-43a2d47e3ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.661095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371d8d-e829-46c3-a57d-43a2d47e3ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.722312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2d371d8d-e829-46c3-a57d-43a2d47e3ea9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:45.725153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2d371d8d-e829-46c3-a57d-43a2d47e3ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:45.886544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 830/1652] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:45.886544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f613f4d-86fa-4d89-b2ab-50f20db990c1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:45.886544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f613f4d-86fa-4d89-b2ab-50f20db990c1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:45.886544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f613f4d-86fa-4d89-b2ab-50f20db990c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:45.954871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1f613f4d-86fa-4d89-b2ab-50f20db990c1 None None] MFA Rules not processed for user `b9779a683e954facac0994a1866a0e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:45.956132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f613f4d-86fa-4d89-b2ab-50f20db990c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.032140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 823/1653] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:46.033288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358f26d-a610-4288-b84c-ef788b7d8a5b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.034808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b358f26d-a610-4288-b84c-ef788b7d8a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.036267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:46.130877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358f26d-a610-4288-b84c-ef788b7d8a5b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.139548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.140448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.140880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.141446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.163871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.167839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.172484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 831/1654] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:46.176366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f613f4d-86fa-4d89-b2ab-50f20db990c1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.182615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f613f4d-86fa-4d89-b2ab-50f20db990c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.199031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 824/1655] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:46.199951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.201963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.219182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba8a0-2a36-4463-b545-04bead5caa0b service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.226197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d265b-c169-49d9-91da-f3e28d7ca3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.227943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d265b-c169-49d9-91da-f3e28d7ca3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.229151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d265b-c169-49d9-91da-f3e28d7ca3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.229441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d265b-c169-49d9-91da-f3e28d7ca3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.230734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d265b-c169-49d9-91da-f3e28d7ca3fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.232858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d265b-c169-49d9-91da-f3e28d7ca3fd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.283313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 825/1656] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/projects => generated 405 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:46.285524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d265b-c169-49d9-91da-f3e28d7ca3fd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.346187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f613f4d-86fa-4d89-b2ab-50f20db990c1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.457027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d265b-c169-49d9-91da-f3e28d7ca3fd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.471591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6c63-fe9b-4856-8ce1-02787ac48240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.472285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6c63-fe9b-4856-8ce1-02787ac48240 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.472568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6c63-fe9b-4856-8ce1-02787ac48240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.473082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6c63-fe9b-4856-8ce1-02787ac48240 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.473718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b6c63-fe9b-4856-8ce1-02787ac48240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.478716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b6c63-fe9b-4856-8ce1-02787ac48240 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.533119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 826/1657] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/users => generated 309 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:46.533276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.533737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.533941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.534221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6c63-fe9b-4856-8ce1-02787ac48240 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.534389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.546613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.555614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6c63-fe9b-4856-8ce1-02787ac48240 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.573998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.575020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.575313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.575600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.576421 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.578120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.627734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 827/1658] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:36:46.639023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.647825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.678342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036fa83-e98a-42d7-9e77-e5e754a9af22 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.699992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.700910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.701200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.701481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] PATH_INFO: `/v3/projects/eaa5b5d1b2f8446ebedf6c5b17779493` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.704956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa5b5d1b2f8446ebedf6c5b17779493)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.707052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.712388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:46.756077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.757913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.773223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:46.783488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 832/1659] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:46.801184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.825336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa5b5d1b2f8446ebedf6c5b17779493', 'request_id': 'req-e875b3be-14b1-404b-9be8-bb44978a6a5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:46.836380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa5b5d1b2f8446ebedf6c5b17779493', 'request_id': 'req-e875b3be-14b1-404b-9be8-bb44978a6a5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:46.844732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9077f-e6fb-4c03-8faa-27b4f9e2e8e8 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.853760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa5b5d1b2f8446ebedf6c5b17779493', 'request_id': 'req-e875b3be-14b1-404b-9be8-bb44978a6a5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:46.878530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] The token cache is being invalidate because project eaa5b5d1b2f8446ebedf6c5b17779493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:36:46.879080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:46.879923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:46.882443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 828/1660] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:36:46 2022] DELETE /identity/v3/projects/eaa5b5d1b2f8446ebedf6c5b17779493 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:46.886793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.888679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.032277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.033445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.033815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.034166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] PATH_INFO: `/v3/projects/7c4e2fef00d645f4a9995e510e34ef8a/users/959ca85abf36442289a03d02ef1d651e/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.069986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4e2fef00d645f4a9995e510e34ef8a, user_id=959ca85abf36442289a03d02ef1d651e, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.078401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.096514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875b3be-14b1-404b-9be8-bb44978a6a5d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.110127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.111273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.114467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 833/1661] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:46 2022] PUT /identity/v3/projects/7c4e2fef00d645f4a9995e510e34ef8a/users/959ca85abf36442289a03d02ef1d651e/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:47.117373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.117373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] PATH_INFO: `/v3/users/276686a8f57f4dc4a15f4446ada34311` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.117373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276686a8f57f4dc4a15f4446ada34311)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.119099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.121425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.125102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.221514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276686a8f57f4dc4a15f4446ada34311'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:47.248874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276686a8f57f4dc4a15f4446ada34311'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:47.249611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276686a8f57f4dc4a15f4446ada34311'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:47.266503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276686a8f57f4dc4a15f4446ada34311'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:47.267133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9e451eb6-fde1-4bc9-ad4e-919fd27674f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276686a8f57f4dc4a15f4446ada34311'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:47.272907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23a35-d446-4282-b97f-e3c52d4d0bc0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.279932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.281277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.281581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.281882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.282603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.284339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.302497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 834/1662] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:47.302761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 829/1663] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:46 2022] DELETE /identity/v3/users/276686a8f57f4dc4a15f4446ada34311 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:47.307297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.313376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.334898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17d5aa-2afe-434b-b87d-da2da24062fd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.462698 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c56bdf-4d92-4cec-aca2-217ad02f71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.465472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56bdf-4d92-4cec-aca2-217ad02f71d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.466016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56bdf-4d92-4cec-aca2-217ad02f71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.466465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56bdf-4d92-4cec-aca2-217ad02f71d7 admin admin] PATH_INFO: `/v3/projects/7c4e2fef00d645f4a9995e510e34ef8a/users/959ca85abf36442289a03d02ef1d651e/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.469841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c56bdf-4d92-4cec-aca2-217ad02f71d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4e2fef00d645f4a9995e510e34ef8a, user_id=959ca85abf36442289a03d02ef1d651e, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.475041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c56bdf-4d92-4cec-aca2-217ad02f71d7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.495220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 835/1664] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:47 2022] PUT /identity/v3/projects/7c4e2fef00d645f4a9995e510e34ef8a/users/959ca85abf36442289a03d02ef1d651e/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:47.890118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbbc2c-678c-4f2d-b19f-d8db72ad02ee None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.891106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbbc2c-678c-4f2d-b19f-d8db72ad02ee None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.891399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbbc2c-678c-4f2d-b19f-d8db72ad02ee None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.894621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 830/1665] 10.222.0.79 () {54 vars in 912 bytes} [Fri May 27 09:36:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:47.901323 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb890-62bc-4142-a031-cd16248bdda3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.901798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb890-62bc-4142-a031-cd16248bdda3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.902264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb890-62bc-4142-a031-cd16248bdda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.965408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:48.002681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-30fcb890-62bc-4142-a031-cd16248bdda3 None None] MFA Rules not processed for user `ebee38389afb4270b18c6a14c7a4e302`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:48.004429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-30fcb890-62bc-4142-a031-cd16248bdda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:48.082222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 836/1666] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:48.209839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbbc2c-678c-4f2d-b19f-d8db72ad02ee None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.212338 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-96cbbc2c-678c-4f2d-b19f-d8db72ad02ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:48.254862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbbc2c-678c-4f2d-b19f-d8db72ad02ee None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.261024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.262231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.262630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.263013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.269661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:48.274261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.280592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcb890-62bc-4142-a031-cd16248bdda3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.282672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-30fcb890-62bc-4142-a031-cd16248bdda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:48.296022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.349879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 831/1667] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:48.423893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.426154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:48.441560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcb890-62bc-4142-a031-cd16248bdda3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.451070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f23983-989d-4a7d-a1c9-a5fcf9655c6e service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.453641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.455300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.455589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.455867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] PATH_INFO: `/v3/projects/08faaf7af9454fe69f51479199c952a6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.458947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08faaf7af9454fe69f51479199c952a6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.459815 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:48.461699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.462138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.462918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:48.462918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: warnings.warn(msg) May 27 09:36:48.462918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: May 27 09:36:48.463471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] PATH_INFO: `/v3/projects/026b6a985b404b949ecba2f0294628fc` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.468198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] RBAC: Authorizing `identity:delete_project(project_id=026b6a985b404b949ecba2f0294628fc)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:48.469063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.482542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:48.630850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026b6a985b404b949ecba2f0294628fc', 'request_id': 'req-9a428959-3b35-40d2-b7e9-9b062024186a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.657027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026b6a985b404b949ecba2f0294628fc', 'request_id': 'req-9a428959-3b35-40d2-b7e9-9b062024186a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.668390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08faaf7af9454fe69f51479199c952a6', 'request_id': 'req-d274a7fc-ea1c-428c-b090-0500741f9548'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.672911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026b6a985b404b949ecba2f0294628fc', 'request_id': 'req-9a428959-3b35-40d2-b7e9-9b062024186a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.682920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08faaf7af9454fe69f51479199c952a6', 'request_id': 'req-d274a7fc-ea1c-428c-b090-0500741f9548'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.699776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] The token cache is being invalidate because project 026b6a985b404b949ecba2f0294628fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:36:48.700303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.701054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.708500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 832/1668] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:36:48 2022] DELETE /identity/v3/projects/026b6a985b404b949ecba2f0294628fc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:48.711081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:48.718251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:48.734133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08faaf7af9454fe69f51479199c952a6', 'request_id': 'req-d274a7fc-ea1c-428c-b090-0500741f9548'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.778746 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] The token cache is being invalidate because project 08faaf7af9454fe69f51479199c952a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:36:48.779042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.779801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d274a7fc-ea1c-428c-b090-0500741f9548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:48.783369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 837/1669] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:36:48 2022] DELETE /identity/v3/projects/08faaf7af9454fe69f51479199c952a6 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:48.788370 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53705d8-2369-4886-b954-c27847783b95 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.788666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53705d8-2369-4886-b954-c27847783b95 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.789679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53705d8-2369-4886-b954-c27847783b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:48.829466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c53705d8-2369-4886-b954-c27847783b95 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:48.831242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c53705d8-2369-4886-b954-c27847783b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:48.884405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428959-3b35-40d2-b7e9-9b062024186a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:48.927852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:48.974722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 838/1670] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:48.984371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70569-1d98-486d-8d3e-7e70fab11416 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:48.984669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70569-1d98-486d-8d3e-7e70fab11416 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:48.985107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70569-1d98-486d-8d3e-7e70fab11416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.014669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-02e70569-1d98-486d-8d3e-7e70fab11416 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:49.016065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-02e70569-1d98-486d-8d3e-7e70fab11416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:49.027950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 839/1671] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:49.032969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e70569-1d98-486d-8d3e-7e70fab11416 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.061611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e70569-1d98-486d-8d3e-7e70fab11416 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.078263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.079166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.079447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.079724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] PATH_INFO: `/v3/users/ed347271276440e097f3de300aae5313` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.081161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed347271276440e097f3de300aae5313)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.083765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.088493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.089708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.090182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.090610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.093031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:49.093410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.097989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.121993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 840/1672] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:49.122948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.137877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32b884-6882-41d5-b5bd-3e679a7dee34 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.149941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a334-8eb8-4e3d-82ea-859110875de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.150644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a334-8eb8-4e3d-82ea-859110875de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.150983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a334-8eb8-4e3d-82ea-859110875de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.151275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a334-8eb8-4e3d-82ea-859110875de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.152205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961a334-8eb8-4e3d-82ea-859110875de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.154376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961a334-8eb8-4e3d-82ea-859110875de2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.184023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:49.210016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 841/1673] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:49 2022] POST /identity/v3/projects => generated 403 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:49.210834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed347271276440e097f3de300aae5313'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:49.211576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a334-8eb8-4e3d-82ea-859110875de2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.238896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed347271276440e097f3de300aae5313'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:49.240396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed347271276440e097f3de300aae5313'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:49.259647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed347271276440e097f3de300aae5313'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:49.260392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed347271276440e097f3de300aae5313'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:49.288465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 833/1674] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:48 2022] DELETE /identity/v3/users/ed347271276440e097f3de300aae5313 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:49.314903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a334-8eb8-4e3d-82ea-859110875de2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.386049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a898ba-0e2b-4b45-8892-abf7d31f26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.386907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a898ba-0e2b-4b45-8892-abf7d31f26f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.387328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a898ba-0e2b-4b45-8892-abf7d31f26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.387765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a898ba-0e2b-4b45-8892-abf7d31f26f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.388818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a898ba-0e2b-4b45-8892-abf7d31f26f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.390947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a898ba-0e2b-4b45-8892-abf7d31f26f2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.419686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 842/1675] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:49 2022] POST /identity/v3/users => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:36:49.420162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.421757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:49.448573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b960d-c1fc-44a1-bf65-9308e6198099 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.459784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710b59-2816-45d3-abca-f4c31dc0483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.460856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710b59-2816-45d3-abca-f4c31dc0483c admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.461948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710b59-2816-45d3-abca-f4c31dc0483c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.462767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710b59-2816-45d3-abca-f4c31dc0483c admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.465307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a710b59-2816-45d3-abca-f4c31dc0483c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.470638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a710b59-2816-45d3-abca-f4c31dc0483c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.507806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 834/1676] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:36:49.512097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a898ba-0e2b-4b45-8892-abf7d31f26f2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.524430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a898ba-0e2b-4b45-8892-abf7d31f26f2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.532922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e9ddc-9694-4cb0-a876-333f92e089d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.533739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9ddc-9694-4cb0-a876-333f92e089d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.534258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9ddc-9694-4cb0-a876-333f92e089d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.534506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e9ddc-9694-4cb0-a876-333f92e089d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.535781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e9ddc-9694-4cb0-a876-333f92e089d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.537760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e9ddc-9694-4cb0-a876-333f92e089d9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.549883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 843/1677] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:49.554135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710b59-2816-45d3-abca-f4c31dc0483c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:49.578932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710b59-2816-45d3-abca-f4c31dc0483c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:49.590441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d811-4be7-4212-a4f4-6f8f510b8cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:49.591697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d811-4be7-4212-a4f4-6f8f510b8cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.593076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d811-4be7-4212-a4f4-6f8f510b8cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.593561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d811-4be7-4212-a4f4-6f8f510b8cce admin admin] PATH_INFO: `/v3/projects/4219055caa6c466790c9dd7ee9428eac/users/1a70a42af06b409b8fbc2e507d3ccfd7/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.625920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2d811-4be7-4212-a4f4-6f8f510b8cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4219055caa6c466790c9dd7ee9428eac, user_id=1a70a42af06b409b8fbc2e507d3ccfd7, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:49.632259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2d811-4be7-4212-a4f4-6f8f510b8cce admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:49.666035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 835/1678] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:49 2022] PUT /identity/v3/projects/4219055caa6c466790c9dd7ee9428eac/users/1a70a42af06b409b8fbc2e507d3ccfd7/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:36:49.669741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c54c8-c9c2-471c-9769-353b2a5bbdfa None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:49.670040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c54c8-c9c2-471c-9769-353b2a5bbdfa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:49.670322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c54c8-c9c2-471c-9769-353b2a5bbdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:49.710589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-272c54c8-c9c2-471c-9769-353b2a5bbdfa None None] MFA Rules not processed for user `1a70a42af06b409b8fbc2e507d3ccfd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:49.713039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-272c54c8-c9c2-471c-9769-353b2a5bbdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:49.738454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:49.827867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 844/1679] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:49.829122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d811-4be7-4212-a4f4-6f8f510b8cce admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.009242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d811-4be7-4212-a4f4-6f8f510b8cce admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.021632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae74ce-de29-419c-bdd8-55154e3a0345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.022320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae74ce-de29-419c-bdd8-55154e3a0345 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.022693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae74ce-de29-419c-bdd8-55154e3a0345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.022869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae74ce-de29-419c-bdd8-55154e3a0345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.027376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae74ce-de29-419c-bdd8-55154e3a0345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.032789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae74ce-de29-419c-bdd8-55154e3a0345 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.084757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c54c8-c9c2-471c-9769-353b2a5bbdfa None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.087487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-272c54c8-c9c2-471c-9769-353b2a5bbdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:50.114572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 836/1680] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:49 2022] POST /identity/v3/projects => generated 405 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:50.120191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae74ce-de29-419c-bdd8-55154e3a0345 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.131404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c54c8-c9c2-471c-9769-353b2a5bbdfa None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.383539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:50.393326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.394223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.394506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.394787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] PATH_INFO: `/v3/projects/c1729027b45740b7b539d9a060164cbd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.396296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae74ce-de29-419c-bdd8-55154e3a0345 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.396980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1729027b45740b7b539d9a060164cbd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.425221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.432666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce2462-2268-4dc2-9d3b-b01501b2669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.433297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2462-2268-4dc2-9d3b-b01501b2669a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.433583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2462-2268-4dc2-9d3b-b01501b2669a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.433974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce2462-2268-4dc2-9d3b-b01501b2669a admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.434565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce2462-2268-4dc2-9d3b-b01501b2669a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.456017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce2462-2268-4dc2-9d3b-b01501b2669a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.512740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 837/1681] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:50 2022] POST /identity/v3/users => generated 309 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:50.515056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4cca-0f9f-432c-a9f4-6da598af4f68 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.516205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4cca-0f9f-432c-a9f4-6da598af4f68 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.516501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4cca-0f9f-432c-a9f4-6da598af4f68 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.520375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 838/1682] 10.222.0.79 () {54 vars in 960 bytes} [Fri May 27 09:36:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:50.521221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4cca-0f9f-432c-a9f4-6da598af4f68 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.525518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-78cd4cca-0f9f-432c-a9f4-6da598af4f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:50.571904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1729027b45740b7b539d9a060164cbd', 'request_id': 'req-a613819b-a1ff-4e0a-9301-0dc532e6d523'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.590637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1729027b45740b7b539d9a060164cbd', 'request_id': 'req-a613819b-a1ff-4e0a-9301-0dc532e6d523'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.607416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1729027b45740b7b539d9a060164cbd', 'request_id': 'req-a613819b-a1ff-4e0a-9301-0dc532e6d523'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.655410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] The token cache is being invalidate because project c1729027b45740b7b539d9a060164cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:36:50.655664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.658758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.662417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 845/1683] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:36:50 2022] DELETE /identity/v3/projects/c1729027b45740b7b539d9a060164cbd => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:50.665272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.667478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:50.677043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4cca-0f9f-432c-a9f4-6da598af4f68 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.684822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.686079 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.686079 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.686379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] PATH_INFO: `/v3/users/e47f27ecdea94a38872b1e47c4bdbc87` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.687753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47f27ecdea94a38872b1e47c4bdbc87)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.689842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.703729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613819b-a1ff-4e0a-9301-0dc532e6d523 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:50.714774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0691b-1fa8-439f-8259-928179d2cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:50.715536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0691b-1fa8-439f-8259-928179d2cf84 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.715897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0691b-1fa8-439f-8259-928179d2cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.717252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0691b-1fa8-439f-8259-928179d2cf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.721336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0691b-1fa8-439f-8259-928179d2cf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:50.724264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0691b-1fa8-439f-8259-928179d2cf84 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:50.753216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 846/1684] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:50.754792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb62fa-70dc-4758-b156-f6f67dfa5a9b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.755101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb62fa-70dc-4758-b156-f6f67dfa5a9b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.755991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb62fa-70dc-4758-b156-f6f67dfa5a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.789972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4afb62fa-70dc-4758-b156-f6f67dfa5a9b None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:50.791541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4afb62fa-70dc-4758-b156-f6f67dfa5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:50.794519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47f27ecdea94a38872b1e47c4bdbc87'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.809715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47f27ecdea94a38872b1e47c4bdbc87'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.810629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47f27ecdea94a38872b1e47c4bdbc87'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.824669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47f27ecdea94a38872b1e47c4bdbc87'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.825497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2107e358-62cf-447d-8adc-c1d1b57c7aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47f27ecdea94a38872b1e47c4bdbc87'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:50.826527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:50.850480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 839/1685] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:50 2022] DELETE /identity/v3/users/e47f27ecdea94a38872b1e47c4bdbc87 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:50.852985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996e716-5b51-455b-afd8-46fcbf93785a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:50.853393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996e716-5b51-455b-afd8-46fcbf93785a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:50.853612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996e716-5b51-455b-afd8-46fcbf93785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:50.877474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9996e716-5b51-455b-afd8-46fcbf93785a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:50.878727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9996e716-5b51-455b-afd8-46fcbf93785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:50.904123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 847/1686] 10.222.0.79 () {58 vars in 1057 bytes} [Fri May 27 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:50.905954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb62fa-70dc-4758-b156-f6f67dfa5a9b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:50.908142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4afb62fa-70dc-4758-b156-f6f67dfa5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:50.931195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb62fa-70dc-4758-b156-f6f67dfa5a9b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.025960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.027731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.028739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.029762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] PATH_INFO: `/v3/projects/7f5685a945bb4be8a9bec779e374f9ea` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.031018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 840/1687] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:51.031694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996e716-5b51-455b-afd8-46fcbf93785a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:51.040651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9996e716-5b51-455b-afd8-46fcbf93785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.042220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f5685a945bb4be8a9bec779e374f9ea)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.044341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.063413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:51.081471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996e716-5b51-455b-afd8-46fcbf93785a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.090722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dda32d-9052-40d7-81e7-1e830569fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.092337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dda32d-9052-40d7-81e7-1e830569fb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.092878 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dda32d-9052-40d7-81e7-1e830569fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.093249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dda32d-9052-40d7-81e7-1e830569fb7a admin admin] PATH_INFO: `/v3/projects/7523156002ed4b79a675ff2bfd1e0453/users/a59018baa75b41b29277355a7f93a8e7/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.122250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dda32d-9052-40d7-81e7-1e830569fb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7523156002ed4b79a675ff2bfd1e0453, user_id=a59018baa75b41b29277355a7f93a8e7, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.125031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dda32d-9052-40d7-81e7-1e830569fb7a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.147966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5685a945bb4be8a9bec779e374f9ea', 'request_id': 'req-fc79d321-6b08-4b4c-8839-425facf4657b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:51.157449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 841/1688] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:51 2022] PUT /identity/v3/projects/7523156002ed4b79a675ff2bfd1e0453/users/a59018baa75b41b29277355a7f93a8e7/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:51.157642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5685a945bb4be8a9bec779e374f9ea', 'request_id': 'req-fc79d321-6b08-4b4c-8839-425facf4657b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:51.158267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb24522-18dd-4536-a026-2902ca8efb26 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.158570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb24522-18dd-4536-a026-2902ca8efb26 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.158857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb24522-18dd-4536-a026-2902ca8efb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.165937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5685a945bb4be8a9bec779e374f9ea', 'request_id': 'req-fc79d321-6b08-4b4c-8839-425facf4657b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:51.184864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] The token cache is being invalidate because project 7f5685a945bb4be8a9bec779e374f9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:36:51.185196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:51.186459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:51.188781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7bb24522-18dd-4536-a026-2902ca8efb26 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:51.188947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 848/1689] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:36:50 2022] DELETE /identity/v3/projects/7f5685a945bb4be8a9bec779e374f9ea => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:51.192096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:51.193779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7bb24522-18dd-4536-a026-2902ca8efb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.194857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.279963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 842/1690] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:51.281604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a0ffb-c785-4de1-b9f7-659c11543ed3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.281972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a0ffb-c785-4de1-b9f7-659c11543ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.282362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a0ffb-c785-4de1-b9f7-659c11543ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.325428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:51.333043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79d321-6b08-4b4c-8839-425facf4657b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.350459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f20a0ffb-c785-4de1-b9f7-659c11543ed3 None None] MFA Rules not processed for user `43d9ae4fd922444e9f70fe79d4cacb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:51.352373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f20a0ffb-c785-4de1-b9f7-659c11543ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.408609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad8534-3363-4780-9b0e-49d63ba3cdcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.409541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad8534-3363-4780-9b0e-49d63ba3cdcc service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.409944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad8534-3363-4780-9b0e-49d63ba3cdcc service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.411884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad8534-3363-4780-9b0e-49d63ba3cdcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.414825 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2dad8534-3363-4780-9b0e-49d63ba3cdcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.429857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad8534-3363-4780-9b0e-49d63ba3cdcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.432697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad8534-3363-4780-9b0e-49d63ba3cdcc service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.447383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 849/1691] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:51.450117 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934ec1-6ce1-493b-bd9e-4a9b286b3e5c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.450629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934ec1-6ce1-493b-bd9e-4a9b286b3e5c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.451084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934ec1-6ce1-493b-bd9e-4a9b286b3e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.479466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eb934ec1-6ce1-493b-bd9e-4a9b286b3e5c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:51.481194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eb934ec1-6ce1-493b-bd9e-4a9b286b3e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.484910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 843/1692] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:51.486480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1052-e67d-4d59-bfc5-ae720ef0ad69 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.486986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1052-e67d-4d59-bfc5-ae720ef0ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.487506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1052-e67d-4d59-bfc5-ae720ef0ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.500692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 850/1693] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:51.501905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934ec1-6ce1-493b-bd9e-4a9b286b3e5c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:51.506810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eb934ec1-6ce1-493b-bd9e-4a9b286b3e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.549559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934ec1-6ce1-493b-bd9e-4a9b286b3e5c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.552947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d5df1052-e67d-4d59-bfc5-ae720ef0ad69 None None] MFA Rules not processed for user `959ca85abf36442289a03d02ef1d651e`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:51.554564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d5df1052-e67d-4d59-bfc5-ae720ef0ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.571461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e5d31-f41d-4985-b91c-8f5f95488cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.572412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5d31-f41d-4985-b91c-8f5f95488cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.572965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5d31-f41d-4985-b91c-8f5f95488cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.573619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5d31-f41d-4985-b91c-8f5f95488cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.574798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e5d31-f41d-4985-b91c-8f5f95488cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.580492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e5d31-f41d-4985-b91c-8f5f95488cb3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.618227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 851/1694] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:51.643295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486040-2df3-4484-a9e1-25d5921532b9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.644166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486040-2df3-4484-a9e1-25d5921532b9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.644877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486040-2df3-4484-a9e1-25d5921532b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.693770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:51.698428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a0486040-2df3-4484-a9e1-25d5921532b9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:51.703567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a0486040-2df3-4484-a9e1-25d5921532b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.721524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 844/1695] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:51.721524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1052-e67d-4d59-bfc5-ae720ef0ad69 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:51.722150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d5df1052-e67d-4d59-bfc5-ae720ef0ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.744224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 852/1696] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:51.750255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095264-4aab-42f7-a6af-1ef31a624ff7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.751060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095264-4aab-42f7-a6af-1ef31a624ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.751610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095264-4aab-42f7-a6af-1ef31a624ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.806528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ee095264-4aab-42f7-a6af-1ef31a624ff7 None None] MFA Rules not processed for user `43d9ae4fd922444e9f70fe79d4cacb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:51.807778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ee095264-4aab-42f7-a6af-1ef31a624ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.822894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 853/1697] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:51.823792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095264-4aab-42f7-a6af-1ef31a624ff7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:51.846101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095264-4aab-42f7-a6af-1ef31a624ff7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.857954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1052-e67d-4d59-bfc5-ae720ef0ad69 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.859880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.860706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.861274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.861574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.862664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:51.862664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.864203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.866070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2efa08-5262-41e3-b13a-b9183e43e05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.866360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2efa08-5262-41e3-b13a-b9183e43e05f service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.866648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2efa08-5262-41e3-b13a-b9183e43e05f service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.866929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2efa08-5262-41e3-b13a-b9183e43e05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.896562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 854/1698] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:51.897469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:51.901381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2efa08-5262-41e3-b13a-b9183e43e05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.902863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2efa08-5262-41e3-b13a-b9183e43e05f service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.923886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a877c-1305-4b89-bbdf-7ef9a9fdd0f4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:51.936180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 845/1699] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:51.937580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91a39-7bc4-4751-b414-2d3b6f49477a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.937870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91a39-7bc4-4751-b414-2d3b6f49477a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.938153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91a39-7bc4-4751-b414-2d3b6f49477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.942960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:51.943888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:51.944521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:51.944521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] PATH_INFO: `/v3/projects/7523156002ed4b79a675ff2bfd1e0453/users/a59018baa75b41b29277355a7f93a8e7/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:51.951900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7523156002ed4b79a675ff2bfd1e0453, user_id=a59018baa75b41b29277355a7f93a8e7, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:51.955156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:51.983870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-92f91a39-7bc4-4751-b414-2d3b6f49477a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:51.985147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-92f91a39-7bc4-4751-b414-2d3b6f49477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:51.998308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 855/1700] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:51 2022] PUT /identity/v3/projects/7523156002ed4b79a675ff2bfd1e0453/users/a59018baa75b41b29277355a7f93a8e7/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:51.999303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:52.013292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:52.128795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 846/1701] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:52.129838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f91a39-7bc4-4751-b414-2d3b6f49477a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:52.156979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f91a39-7bc4-4751-b414-2d3b6f49477a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:52.166871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d7f8a-5b7d-44ab-a02f-9422901ace0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:52.167556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7f8a-5b7d-44ab-a02f-9422901ace0d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:52.167843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7f8a-5b7d-44ab-a02f-9422901ace0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:52.173159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7f8a-5b7d-44ab-a02f-9422901ace0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:52.173941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d7f8a-5b7d-44ab-a02f-9422901ace0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:52.175906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d7f8a-5b7d-44ab-a02f-9422901ace0d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:52.245680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 847/1702] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:52 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:52.253403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291e0f-49f5-49f2-99a6-615ccfa7c7ad None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:52.253784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291e0f-49f5-49f2-99a6-615ccfa7c7ad None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:52.254076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291e0f-49f5-49f2-99a6-615ccfa7c7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:52.281707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd6775-06d0-48b7-86d2-556c1b725921 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:52.313356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c4291e0f-49f5-49f2-99a6-615ccfa7c7ad None None] MFA Rules not processed for user `a59018baa75b41b29277355a7f93a8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:52.314679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c4291e0f-49f5-49f2-99a6-615ccfa7c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:52.406093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:52.417169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 848/1703] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:52.418744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4291e0f-49f5-49f2-99a6-615ccfa7c7ad None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:52.424062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:52.506598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:52.507279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:52.508395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:52.509157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:52.573174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4291e0f-49f5-49f2-99a6-615ccfa7c7ad None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:52.588130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:52.589058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:52.589791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:52.590243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:52.591233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:52.591718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:52.595733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:52.627807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 849/1704] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:52.636808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:52.649031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:52.651743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:52.673480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378286a-69d1-481b-bb26-c22395c3c2a2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:52.693414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1555a-ee0e-43d0-a3e4-1dce5b4d24b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:52.693635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1555a-ee0e-43d0-a3e4-1dce5b4d24b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:52.693956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1555a-ee0e-43d0-a3e4-1dce5b4d24b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:52.694179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1555a-ee0e-43d0-a3e4-1dce5b4d24b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:52.694879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1555a-ee0e-43d0-a3e4-1dce5b4d24b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:52.697424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1555a-ee0e-43d0-a3e4-1dce5b4d24b4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:52.701629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 856/1705] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:52.705462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:52.714491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:52.768596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 850/1706] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:52 2022] POST /identity/v3/users => generated 284 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:52.788464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1555a-ee0e-43d0-a3e4-1dce5b4d24b4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:52.823304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1555a-ee0e-43d0-a3e4-1dce5b4d24b4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:52.853370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcb3e8-11e8-4e48-9c02-245159b22150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:52.854218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb3e8-11e8-4e48-9c02-245159b22150 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:52.855942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb3e8-11e8-4e48-9c02-245159b22150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:52.856413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb3e8-11e8-4e48-9c02-245159b22150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:52.857987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcb3e8-11e8-4e48-9c02-245159b22150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:52.871999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcb3e8-11e8-4e48-9c02-245159b22150 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:52.932744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4da2db-7080-4202-99bf-3458b0e84eda service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:52.944062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d045e8-dc9a-4485-bd9a-be341ec6d99d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:52.944738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d045e8-dc9a-4485-bd9a-be341ec6d99d service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:52.945049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d045e8-dc9a-4485-bd9a-be341ec6d99d service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:52.945895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d045e8-dc9a-4485-bd9a-be341ec6d99d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:52.952496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 851/1707] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:52 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:52.953527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcb3e8-11e8-4e48-9c02-245159b22150 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:52.981816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d045e8-dc9a-4485-bd9a-be341ec6d99d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:52.983294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d045e8-dc9a-4485-bd9a-be341ec6d99d service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.018970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 857/1708] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:53.025520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d045e8-dc9a-4485-bd9a-be341ec6d99d service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.060447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d045e8-dc9a-4485-bd9a-be341ec6d99d service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:53.149063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcb3e8-11e8-4e48-9c02-245159b22150 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:53.156813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece5108-3d49-4550-ace4-e2ff7a01a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:53.158456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece5108-3d49-4550-ace4-e2ff7a01a39b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.158846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece5108-3d49-4550-ace4-e2ff7a01a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.159195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece5108-3d49-4550-ace4-e2ff7a01a39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.160193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece5108-3d49-4550-ace4-e2ff7a01a39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:53.162205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece5108-3d49-4550-ace4-e2ff7a01a39b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.193331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 852/1709] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:53.197629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece5108-3d49-4550-ace4-e2ff7a01a39b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.234297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece5108-3d49-4550-ace4-e2ff7a01a39b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:53.248804 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f7f06-ed1c-42b3-bff1-48b31a244e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:53.251758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f7f06-ed1c-42b3-bff1-48b31a244e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.252056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f7f06-ed1c-42b3-bff1-48b31a244e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.252340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f7f06-ed1c-42b3-bff1-48b31a244e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.254903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f7f06-ed1c-42b3-bff1-48b31a244e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:53.259317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f7f06-ed1c-42b3-bff1-48b31a244e13 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.265523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a112b-f021-4680-99eb-b5944a4a87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:53.266156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a112b-f021-4680-99eb-b5944a4a87cf admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.266451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a112b-f021-4680-99eb-b5944a4a87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.266730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a112b-f021-4680-99eb-b5944a4a87cf admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.270254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a112b-f021-4680-99eb-b5944a4a87cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:53.272242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a112b-f021-4680-99eb-b5944a4a87cf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.281584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 853/1710] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:53.286085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f7f06-ed1c-42b3-bff1-48b31a244e13 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.323303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 858/1711] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:53 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:53.326380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f7f06-ed1c-42b3-bff1-48b31a244e13 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:53.331624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a112b-f021-4680-99eb-b5944a4a87cf admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.337776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:53.341566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abe278-9304-42eb-9b6f-a2fb25145fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:53.343457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abe278-9304-42eb-9b6f-a2fb25145fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.343741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abe278-9304-42eb-9b6f-a2fb25145fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.345304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abe278-9304-42eb-9b6f-a2fb25145fc3 admin admin] PATH_INFO: `/v3/projects/78ac6f53b75b4719b76f95d23da83859/users/be5156ed714b4cfcbe894b40c590ba22/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.353051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a112b-f021-4680-99eb-b5944a4a87cf admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:53.371648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e36e-b211-4548-944c-6a679738555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:53.372348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e36e-b211-4548-944c-6a679738555f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.372632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e36e-b211-4548-944c-6a679738555f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.372932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e36e-b211-4548-944c-6a679738555f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.373671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5e36e-b211-4548-944c-6a679738555f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:53.375304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5e36e-b211-4548-944c-6a679738555f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.389897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abe278-9304-42eb-9b6f-a2fb25145fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ac6f53b75b4719b76f95d23da83859, user_id=be5156ed714b4cfcbe894b40c590ba22, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:53.392607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abe278-9304-42eb-9b6f-a2fb25145fc3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.410559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 859/1712] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:53.411551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e36e-b211-4548-944c-6a679738555f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.421190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 854/1713] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:53 2022] PUT /identity/v3/projects/78ac6f53b75b4719b76f95d23da83859/users/be5156ed714b4cfcbe894b40c590ba22/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:53.422139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abe278-9304-42eb-9b6f-a2fb25145fc3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.459311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e36e-b211-4548-944c-6a679738555f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:53.473805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:53.612680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:53.615034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.615034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.622632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] PATH_INFO: `/v3/users/1a70a42af06b409b8fbc2e507d3ccfd7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.625933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a70a42af06b409b8fbc2e507d3ccfd7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:53.627918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.647530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abe278-9304-42eb-9b6f-a2fb25145fc3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:53.675018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddaac4-22df-464f-8de0-a85cd85f425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:53.675709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddaac4-22df-464f-8de0-a85cd85f425e admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.676137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddaac4-22df-464f-8de0-a85cd85f425e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.676421 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddaac4-22df-464f-8de0-a85cd85f425e admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.677192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddaac4-22df-464f-8de0-a85cd85f425e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:53.678838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddaac4-22df-464f-8de0-a85cd85f425e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:53.721585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 855/1714] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:53.725174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992b2b6-af64-4810-87a8-3c95ef8b36c9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:53.727271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992b2b6-af64-4810-87a8-3c95ef8b36c9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:53.727516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992b2b6-af64-4810-87a8-3c95ef8b36c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:53.796204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a70a42af06b409b8fbc2e507d3ccfd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:53.823732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7992b2b6-af64-4810-87a8-3c95ef8b36c9 None None] MFA Rules not processed for user `be5156ed714b4cfcbe894b40c590ba22`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:53.825182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7992b2b6-af64-4810-87a8-3c95ef8b36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:53.826259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a70a42af06b409b8fbc2e507d3ccfd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:53.840609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a70a42af06b409b8fbc2e507d3ccfd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:53.841292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a70a42af06b409b8fbc2e507d3ccfd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:53.842332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a70a42af06b409b8fbc2e507d3ccfd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:53.868194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 860/1715] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:53 2022] DELETE /identity/v3/users/1a70a42af06b409b8fbc2e507d3ccfd7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:53.869357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.879686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:53.978839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 856/1716] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:53.979698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992b2b6-af64-4810-87a8-3c95ef8b36c9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:53.981173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7992b2b6-af64-4810-87a8-3c95ef8b36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:54.017218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc57cba-d829-404e-aa9e-555ba9eb0942 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:54.023967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:54.025358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.025706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.026557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] PATH_INFO: `/v3/projects/75b3548a4fad4430b7e035eb32e46f2f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.027479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b3548a4fad4430b7e035eb32e46f2f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:54.027694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992b2b6-af64-4810-87a8-3c95ef8b36c9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:54.029596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:54.044363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:54.046032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd0a25-5a29-4466-b85d-6a8ed0a83e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:54.059101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0a25-5a29-4466-b85d-6a8ed0a83e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.060611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0a25-5a29-4466-b85d-6a8ed0a83e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.062785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0a25-5a29-4466-b85d-6a8ed0a83e17 admin admin] PATH_INFO: `/v3/projects/2c34fdcef7ee430faea757110cde49a2/users/f305376f9ee6436ea757f07f8a1241a7/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.103198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b3548a4fad4430b7e035eb32e46f2f', 'request_id': 'req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.122979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b3548a4fad4430b7e035eb32e46f2f', 'request_id': 'req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.130387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b3548a4fad4430b7e035eb32e46f2f', 'request_id': 'req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.136268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd0a25-5a29-4466-b85d-6a8ed0a83e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c34fdcef7ee430faea757110cde49a2, user_id=f305376f9ee6436ea757f07f8a1241a7, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:54.139711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd0a25-5a29-4466-b85d-6a8ed0a83e17 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:54.161452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] The token cache is being invalidate because project 75b3548a4fad4430b7e035eb32e46f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:36:54.162837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.165283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:54.167423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 857/1717] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:53 2022] PUT /identity/v3/projects/2c34fdcef7ee430faea757110cde49a2/users/f305376f9ee6436ea757f07f8a1241a7/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:54.171919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 861/1718] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:36:53 2022] DELETE /identity/v3/projects/75b3548a4fad4430b7e035eb32e46f2f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:54.171919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:54.173823 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e121fc-2d12-452d-bea1-ccdcf2cc616a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.173957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:54.174554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e121fc-2d12-452d-bea1-ccdcf2cc616a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.177066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e121fc-2d12-452d-bea1-ccdcf2cc616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.232806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-62e121fc-2d12-452d-bea1-ccdcf2cc616a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:54.237947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-62e121fc-2d12-452d-bea1-ccdcf2cc616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:54.392801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a67a-7ba5-4b86-b328-2f35c8bbc4ff admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:54.438443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 858/1719] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:54.439928 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c069-c04d-4e9b-ac84-b8c74c9a31bc None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.440227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c069-c04d-4e9b-ac84-b8c74c9a31bc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.440511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c069-c04d-4e9b-ac84-b8c74c9a31bc None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.446724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 859/1720] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:36:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:54.448189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52490-9ab9-4878-9349-5034de1dbb95 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.448485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52490-9ab9-4878-9349-5034de1dbb95 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.448768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52490-9ab9-4878-9349-5034de1dbb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.517703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c8842-73f6-4c26-9424-8ffef21c1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:54.518508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8842-73f6-4c26-9424-8ffef21c1735 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.518872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8842-73f6-4c26-9424-8ffef21c1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.519229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8842-73f6-4c26-9424-8ffef21c1735 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.520007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c8842-73f6-4c26-9424-8ffef21c1735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:54.520107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3cb52490-9ab9-4878-9349-5034de1dbb95 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:54.521410 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3cb52490-9ab9-4878-9349-5034de1dbb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:54.522221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c8842-73f6-4c26-9424-8ffef21c1735 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:54.547096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 860/1721] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:54.548796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3144192-06be-4f8e-a333-4d3a40f1dfd1 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.549117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3144192-06be-4f8e-a333-4d3a40f1dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.549400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3144192-06be-4f8e-a333-4d3a40f1dfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.602386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 862/1722] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:54 2022] POST /identity/v3/projects => generated 365 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:54.603546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f778d-d3e6-4b9c-9405-41fbd4e67a30 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.603838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f778d-d3e6-4b9c-9405-41fbd4e67a30 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.604118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f778d-d3e6-4b9c-9405-41fbd4e67a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.623103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:54.632809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c3144192-06be-4f8e-a333-4d3a40f1dfd1 None None] MFA Rules not processed for user `f305376f9ee6436ea757f07f8a1241a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:54.634192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c3144192-06be-4f8e-a333-4d3a40f1dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:54.707325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dd0f778d-d3e6-4b9c-9405-41fbd4e67a30 None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:54.708589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dd0f778d-d3e6-4b9c-9405-41fbd4e67a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:54.788874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:54.814996 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 861/1723] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:54.814996 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3144192-06be-4f8e-a333-4d3a40f1dfd1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:54.818235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c3144192-06be-4f8e-a333-4d3a40f1dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:54.873924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 863/1724] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:54.875210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cc2d9-c727-4922-858b-413a8c250a9a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:54.875503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cc2d9-c727-4922-858b-413a8c250a9a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:54.876127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cc2d9-c727-4922-858b-413a8c250a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:54.918041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bb5cc2d9-c727-4922-858b-413a8c250a9a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:54.919319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bb5cc2d9-c727-4922-858b-413a8c250a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.023706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3144192-06be-4f8e-a333-4d3a40f1dfd1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.032943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.033962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.034461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.034939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.049391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 864/1725] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:55.050273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cc2d9-c727-4922-858b-413a8c250a9a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.060972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.075093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cc2d9-c727-4922-858b-413a8c250a9a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.075601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.082169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.082868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.083207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.083416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.084120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.086633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.111392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 862/1726] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:55.112277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.116931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.152385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada9390-8ddf-41c7-bc8f-285bd0ad2c51 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.160612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 865/1727] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:55 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:55.161304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.166576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f60728-b880-4611-87a7-cbaff0d562e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.167433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f60728-b880-4611-87a7-cbaff0d562e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.167776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f60728-b880-4611-87a7-cbaff0d562e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.168322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f60728-b880-4611-87a7-cbaff0d562e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.169494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f60728-b880-4611-87a7-cbaff0d562e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.173378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f60728-b880-4611-87a7-cbaff0d562e6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.177711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.217903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcc81c-8dda-4689-bd33-05dac5aeb6f2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.232428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84056e-f90b-4e23-9dbb-c40f5b94f11a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.233461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84056e-f90b-4e23-9dbb-c40f5b94f11a service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.234071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84056e-f90b-4e23-9dbb-c40f5b94f11a service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.234641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84056e-f90b-4e23-9dbb-c40f5b94f11a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.246107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 863/1728] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:55 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:55.246107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f60728-b880-4611-87a7-cbaff0d562e6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.260058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84056e-f90b-4e23-9dbb-c40f5b94f11a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.261713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84056e-f90b-4e23-9dbb-c40f5b94f11a service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.297238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 866/1729] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:55.298924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69e3d-83e4-49d0-a339-a501ed5ea8b8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.299223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69e3d-83e4-49d0-a339-a501ed5ea8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.299509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69e3d-83e4-49d0-a339-a501ed5ea8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.334795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f60728-b880-4611-87a7-cbaff0d562e6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.340015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.340698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.341033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.341311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.342559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:36:55.342897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.345341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.362883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 864/1730] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:55.363653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.384071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e3d7d-50f1-4947-8c7a-9ead132b6b5c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.389986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f52bb-4414-4ea8-a526-00cc70220281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.390602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f52bb-4414-4ea8-a526-00cc70220281 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.390891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f52bb-4414-4ea8-a526-00cc70220281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.392152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f52bb-4414-4ea8-a526-00cc70220281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.392934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f52bb-4414-4ea8-a526-00cc70220281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.397097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f52bb-4414-4ea8-a526-00cc70220281 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.402768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-38b69e3d-83e4-49d0-a339-a501ed5ea8b8 None None] MFA Rules not processed for user `1a3ca370feb4457dbadc476e348ac9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:55.404572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-38b69e3d-83e4-49d0-a339-a501ed5ea8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.425186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 865/1731] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:55.426197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f52bb-4414-4ea8-a526-00cc70220281 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.441834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f52bb-4414-4ea8-a526-00cc70220281 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.448296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402ca58-1dab-4296-9e62-dcbe41865b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.449030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402ca58-1dab-4296-9e62-dcbe41865b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.449317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402ca58-1dab-4296-9e62-dcbe41865b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.449597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402ca58-1dab-4296-9e62-dcbe41865b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.450294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402ca58-1dab-4296-9e62-dcbe41865b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.452254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402ca58-1dab-4296-9e62-dcbe41865b85 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.463323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:55.485560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 866/1732] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:55 2022] POST /identity/v3/users => generated 295 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:55.486975 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862c6d-0e42-4c6c-b067-206bb32c7e4d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.487261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862c6d-0e42-4c6c-b067-206bb32c7e4d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.487539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862c6d-0e42-4c6c-b067-206bb32c7e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.528029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-aa862c6d-0e42-4c6c-b067-206bb32c7e4d None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:55.529477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-aa862c6d-0e42-4c6c-b067-206bb32c7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.570396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 867/1733] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:55.580231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b69e3d-83e4-49d0-a339-a501ed5ea8b8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.608559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b69e3d-83e4-49d0-a339-a501ed5ea8b8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.621701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04ea4-7199-409b-8ae7-ae73cb7ac4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.622537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04ea4-7199-409b-8ae7-ae73cb7ac4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.622931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04ea4-7199-409b-8ae7-ae73cb7ac4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.623333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04ea4-7199-409b-8ae7-ae73cb7ac4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.624143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a04ea4-7199-409b-8ae7-ae73cb7ac4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.626811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a04ea4-7199-409b-8ae7-ae73cb7ac4ee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.661308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 867/1734] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:55.662992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa862c6d-0e42-4c6c-b067-206bb32c7e4d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.692939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 868/1735] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:36:55 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:55.692939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04ea4-7199-409b-8ae7-ae73cb7ac4ee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:55.717619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa862c6d-0e42-4c6c-b067-206bb32c7e4d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.727129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:55.883518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258d97a-e03d-4e06-a85c-50152c435b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.884914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04ea4-7199-409b-8ae7-ae73cb7ac4ee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:55.885781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d97a-e03d-4e06-a85c-50152c435b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.887380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d97a-e03d-4e06-a85c-50152c435b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.888536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d97a-e03d-4e06-a85c-50152c435b45 admin admin] PATH_INFO: `/v3/projects/96c8fab93b8e43a596b3596004c78119/users/7d0e0bb5f0b64865bdfc3434abe844df/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.912113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:55.915368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.916215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258d97a-e03d-4e06-a85c-50152c435b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c8fab93b8e43a596b3596004c78119, user_id=7d0e0bb5f0b64865bdfc3434abe844df, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.919023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258d97a-e03d-4e06-a85c-50152c435b45 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.935184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.935626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.936527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:55.939742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 868/1736] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:55 2022] PUT /identity/v3/projects/96c8fab93b8e43a596b3596004c78119/users/7d0e0bb5f0b64865bdfc3434abe844df/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:55.939742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5649d0a-4756-48c0-81e2-2d1cc8d43251 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:55.939905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:55.939973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5649d0a-4756-48c0-81e2-2d1cc8d43251 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:55.939973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5649d0a-4756-48c0-81e2-2d1cc8d43251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:55.962073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c5649d0a-4756-48c0-81e2-2d1cc8d43251 None None] MFA Rules not processed for user `43d9ae4fd922444e9f70fe79d4cacb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:55.963476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c5649d0a-4756-48c0-81e2-2d1cc8d43251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:55.990155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 869/1737] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:55.993188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.000925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:56.101003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 869/1738] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:56.104944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5649d0a-4756-48c0-81e2-2d1cc8d43251 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.218414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:56.316132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de384d7-cde6-4651-b749-d246047c67c6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.339725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5649d0a-4756-48c0-81e2-2d1cc8d43251 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.355261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53070cb-77ef-4242-948a-3df5614dfcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:56.356654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53070cb-77ef-4242-948a-3df5614dfcbd admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.357876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53070cb-77ef-4242-948a-3df5614dfcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.358831 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53070cb-77ef-4242-948a-3df5614dfcbd admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.361223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53070cb-77ef-4242-948a-3df5614dfcbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:56.365638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53070cb-77ef-4242-948a-3df5614dfcbd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:56.420724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 870/1739] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:36:56 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:36:56.423014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53070cb-77ef-4242-948a-3df5614dfcbd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.458603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53070cb-77ef-4242-948a-3df5614dfcbd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.471628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5908201-1e6d-474a-916c-35fd2e9eec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:56.472325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908201-1e6d-474a-916c-35fd2e9eec94 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.472608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908201-1e6d-474a-916c-35fd2e9eec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.473893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908201-1e6d-474a-916c-35fd2e9eec94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.477239 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5908201-1e6d-474a-916c-35fd2e9eec94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:56.493867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5908201-1e6d-474a-916c-35fd2e9eec94 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:56.517095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79bb76-db9d-4bbb-abf5-d5f54b89492e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:56.517739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79bb76-db9d-4bbb-abf5-d5f54b89492e service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.517739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79bb76-db9d-4bbb-abf5-d5f54b89492e service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.517739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79bb76-db9d-4bbb-abf5-d5f54b89492e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.522400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 871/1740] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:56.523620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5908201-1e6d-474a-916c-35fd2e9eec94 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.547838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5908201-1e6d-474a-916c-35fd2e9eec94 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.558597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:56.560070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.560294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.560566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] PATH_INFO: `/v3/projects/39ff471c0cfa4854a69d20d8e24b78eb/users/533fd6db210a42cca9a54959f6049c13/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.593130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ff471c0cfa4854a69d20d8e24b78eb, user_id=533fd6db210a42cca9a54959f6049c13, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:56.600063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:56.606150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:56.640971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 872/1741] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:56 2022] PUT /identity/v3/projects/39ff471c0cfa4854a69d20d8e24b78eb/users/533fd6db210a42cca9a54959f6049c13/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:56.642279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.645973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:56.657779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79bb76-db9d-4bbb-abf5-d5f54b89492e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:56.659477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79bb76-db9d-4bbb-abf5-d5f54b89492e service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:56.690630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 870/1742] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:56.692786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43cfea-e08b-4289-a287-36660b26af38 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.695269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43cfea-e08b-4289-a287-36660b26af38 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.695710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43cfea-e08b-4289-a287-36660b26af38 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.697868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 871/1743] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:36:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:56.701257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43cfea-e08b-4289-a287-36660b26af38 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.777556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9417485-2d9b-44e0-ad8b-07846f194304 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.785436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:56.786305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.787236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.787236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.882995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43cfea-e08b-4289-a287-36660b26af38 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.889356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484426b-b5e2-4655-94f4-0462d2337c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:56.890211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484426b-b5e2-4655-94f4-0462d2337c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.890719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484426b-b5e2-4655-94f4-0462d2337c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.891085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484426b-b5e2-4655-94f4-0462d2337c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.891959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484426b-b5e2-4655-94f4-0462d2337c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:56.895963 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484426b-b5e2-4655-94f4-0462d2337c3d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:56.912183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:56.914830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:56.920555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 872/1744] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:56.922407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484426b-b5e2-4655-94f4-0462d2337c3d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.931025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 873/1745] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:36:56.932075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.934125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:56.936277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484426b-b5e2-4655-94f4-0462d2337c3d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.943521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e290a3-6aab-4e9b-a0ee-f606b06c6b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:56.944334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e290a3-6aab-4e9b-a0ee-f606b06c6b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:56.944623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e290a3-6aab-4e9b-a0ee-f606b06c6b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:56.946128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e290a3-6aab-4e9b-a0ee-f606b06c6b07 admin admin] PATH_INFO: `/v3/projects/96c8fab93b8e43a596b3596004c78119/users/7d0e0bb5f0b64865bdfc3434abe844df/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:56.949060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e290a3-6aab-4e9b-a0ee-f606b06c6b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c8fab93b8e43a596b3596004c78119, user_id=7d0e0bb5f0b64865bdfc3434abe844df, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:56.952529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e290a3-6aab-4e9b-a0ee-f606b06c6b07 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:56.966113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad9ec3-6f4a-4610-8597-f2c6d28f7ada service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:56.976032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 873/1746] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:56 2022] PUT /identity/v3/projects/96c8fab93b8e43a596b3596004c78119/users/7d0e0bb5f0b64865bdfc3434abe844df/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:56.976032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e290a3-6aab-4e9b-a0ee-f606b06c6b07 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:56.994300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:57.143671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:57.145071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.151464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.153932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] PATH_INFO: `/v3/users/b9779a683e954facac0994a1866a0e84` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.156329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9779a683e954facac0994a1866a0e84)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:57.170345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:57.197995 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e290a3-6aab-4e9b-a0ee-f606b06c6b07 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:57.213160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee52879-de16-48aa-92a3-21b8f3792b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:57.215304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee52879-de16-48aa-92a3-21b8f3792b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.216366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee52879-de16-48aa-92a3-21b8f3792b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.217436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee52879-de16-48aa-92a3-21b8f3792b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.220382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee52879-de16-48aa-92a3-21b8f3792b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:57.228362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee52879-de16-48aa-92a3-21b8f3792b67 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:57.266121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 874/1747] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:57.269244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e74ef-fe43-48ff-9ed0-fb019ed7bf61 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.270968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e74ef-fe43-48ff-9ed0-fb019ed7bf61 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.272057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e74ef-fe43-48ff-9ed0-fb019ed7bf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.325478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8e4e74ef-fe43-48ff-9ed0-fb019ed7bf61 None None] MFA Rules not processed for user `e79a5d5bbecb4835b3e8f4128b347aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:57.326852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8e4e74ef-fe43-48ff-9ed0-fb019ed7bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.383934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9779a683e954facac0994a1866a0e84'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:57.457199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9779a683e954facac0994a1866a0e84'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:57.458063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9779a683e954facac0994a1866a0e84'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:57.475458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9779a683e954facac0994a1866a0e84'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:57.476383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9779a683e954facac0994a1866a0e84'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:57.520724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 874/1748] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:56 2022] DELETE /identity/v3/users/b9779a683e954facac0994a1866a0e84 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:57.521907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:57.528287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.532089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:57.577171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 875/1749] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:57.578674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efaa1e-5818-4a57-a9ae-672fe29a63ea None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.578967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efaa1e-5818-4a57-a9ae-672fe29a63ea None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.579351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efaa1e-5818-4a57-a9ae-672fe29a63ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.677512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e9efaa1e-5818-4a57-a9ae-672fe29a63ea None None] MFA Rules not processed for user `7d0e0bb5f0b64865bdfc3434abe844df`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:57.679141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e9efaa1e-5818-4a57-a9ae-672fe29a63ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.798871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf1f37-f198-4c2e-8dba-6cacf2a1e1f8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:57.828087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:57.830570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.832535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.833687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.845884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:57.845884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:57.886919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 875/1750] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:36:57.887339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:57.892029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.949124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7213a-eecb-4c0f-81a3-9799c9f815c7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:57.957826 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 876/1751] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:57.959663 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efaa1e-5818-4a57-a9ae-672fe29a63ea None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:57.964529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e9efaa1e-5818-4a57-a9ae-672fe29a63ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.966295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:57.969844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.973668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.974954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] PATH_INFO: `/v3/projects/4219055caa6c466790c9dd7ee9428eac` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.980096 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4219055caa6c466790c9dd7ee9428eac)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:57.993625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:57.997832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efaa1e-5818-4a57-a9ae-672fe29a63ea None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:58.003716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac3571-afb3-4dab-b9bd-0b419ea852c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:58.004627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac3571-afb3-4dab-b9bd-0b419ea852c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.004942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac3571-afb3-4dab-b9bd-0b419ea852c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.005381 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac3571-afb3-4dab-b9bd-0b419ea852c3 admin admin] PATH_INFO: `/v3/projects/39ff471c0cfa4854a69d20d8e24b78eb/users/533fd6db210a42cca9a54959f6049c13/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.007489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac3571-afb3-4dab-b9bd-0b419ea852c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ff471c0cfa4854a69d20d8e24b78eb, user_id=533fd6db210a42cca9a54959f6049c13, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:58.010713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac3571-afb3-4dab-b9bd-0b419ea852c3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:58.036962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 877/1752] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:57 2022] PUT /identity/v3/projects/39ff471c0cfa4854a69d20d8e24b78eb/users/533fd6db210a42cca9a54959f6049c13/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:58.040659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d380de-eaf9-43bf-ba6b-9016a0294094 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.040996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d380de-eaf9-43bf-ba6b-9016a0294094 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.041300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d380de-eaf9-43bf-ba6b-9016a0294094 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.043161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 878/1753] 10.222.0.79 () {54 vars in 912 bytes} [Fri May 27 09:36:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:58.044132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d380de-eaf9-43bf-ba6b-9016a0294094 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:58.045837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-93d380de-eaf9-43bf-ba6b-9016a0294094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.100413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:58.139803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4219055caa6c466790c9dd7ee9428eac', 'request_id': 'req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.149155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4219055caa6c466790c9dd7ee9428eac', 'request_id': 'req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.168502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4219055caa6c466790c9dd7ee9428eac', 'request_id': 'req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.192629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] The token cache is being invalidate because project 4219055caa6c466790c9dd7ee9428eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:36:58.193302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.194179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:58.197020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 876/1754] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:36:57 2022] DELETE /identity/v3/projects/4219055caa6c466790c9dd7ee9428eac => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:58.198375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:58.200411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.341375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96ccf-ba11-4b5e-b293-078e74d5c6c7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:58.347155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:58.348321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.348760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.349235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] PATH_INFO: `/v3/projects/4041625898ed4abf8f5c9f573ee87ba4/users/995fa0cda3e140efbf9ec1b33447c145/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.388537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4041625898ed4abf8f5c9f573ee87ba4, user_id=995fa0cda3e140efbf9ec1b33447c145, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:58.394619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:58.395034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d380de-eaf9-43bf-ba6b-9016a0294094 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:58.429673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 877/1755] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:36:58 2022] PUT /identity/v3/projects/4041625898ed4abf8f5c9f573ee87ba4/users/995fa0cda3e140efbf9ec1b33447c145/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:58.430969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:58.436028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.515139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26501168-eda9-4ef5-b8db-8c846112980d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:58.519924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6dd87-3728-4500-a080-51d5431f0404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:58.520940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6dd87-3728-4500-a080-51d5431f0404 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.521639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6dd87-3728-4500-a080-51d5431f0404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.522528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6dd87-3728-4500-a080-51d5431f0404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.525433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5ac6dd87-3728-4500-a080-51d5431f0404 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.604331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:58.627436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6dd87-3728-4500-a080-51d5431f0404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:58.629376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6dd87-3728-4500-a080-51d5431f0404 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:58.643265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 878/1756] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:58.645376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d080-ce28-434f-831c-d99ce4af06ad None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.645832 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d080-ce28-434f-831c-d99ce4af06ad None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.646435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d080-ce28-434f-831c-d99ce4af06ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.685549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fe58d080-ce28-434f-831c-d99ce4af06ad None None] MFA Rules not processed for user `533fd6db210a42cca9a54959f6049c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:58.687085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fe58d080-ce28-434f-831c-d99ce4af06ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.707352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9c1de-a2de-4260-8a4f-99ce5c610f6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:58.708099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9c1de-a2de-4260-8a4f-99ce5c610f6a service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.715883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9c1de-a2de-4260-8a4f-99ce5c610f6a service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.716467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9c1de-a2de-4260-8a4f-99ce5c610f6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.730657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-64b9c1de-a2de-4260-8a4f-99ce5c610f6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.794462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9c1de-a2de-4260-8a4f-99ce5c610f6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:58.798580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9c1de-a2de-4260-8a4f-99ce5c610f6a service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:58.826699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:58.854620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 879/1757] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 811 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:58.885245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74c36-6d49-4509-944c-9a4268181146 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.885593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74c36-6d49-4509-944c-9a4268181146 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.885875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74c36-6d49-4509-944c-9a4268181146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.974629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-aba74c36-6d49-4509-944c-9a4268181146 None None] MFA Rules not processed for user `ebee38389afb4270b18c6a14c7a4e302`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:58.975851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-aba74c36-6d49-4509-944c-9a4268181146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.980291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 879/1758] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:58.981341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58d080-ce28-434f-831c-d99ce4af06ad None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:58.991514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fe58d080-ce28-434f-831c-d99ce4af06ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.187258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 880/1759] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:36:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:59.193023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311bdff-e33d-4700-a70a-14207aaa06aa None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:59.199270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311bdff-e33d-4700-a70a-14207aaa06aa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:59.200118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311bdff-e33d-4700-a70a-14207aaa06aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:59.249285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58d080-ce28-434f-831c-d99ce4af06ad None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:59.268621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:59.277013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:59.277421 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:59.277827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] PATH_INFO: `/v3/users/a59018baa75b41b29277355a7f93a8e7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:59.280076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59018baa75b41b29277355a7f93a8e7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:59.282279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:59.290000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0311bdff-e33d-4700-a70a-14207aaa06aa None None] MFA Rules not processed for user `995fa0cda3e140efbf9ec1b33447c145`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:59.291710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0311bdff-e33d-4700-a70a-14207aaa06aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.394644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59018baa75b41b29277355a7f93a8e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.417448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59018baa75b41b29277355a7f93a8e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.418580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59018baa75b41b29277355a7f93a8e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.443984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59018baa75b41b29277355a7f93a8e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.445082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59018baa75b41b29277355a7f93a8e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:36:59.455715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:59.486621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 880/1760] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:36:58 2022] DELETE /identity/v3/users/a59018baa75b41b29277355a7f93a8e7 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:36:59.487948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:59.494098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 881/1761] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:36:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:59.495157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311bdff-e33d-4700-a70a-14207aaa06aa None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:59.499620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0311bdff-e33d-4700-a70a-14207aaa06aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.508551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.516291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311bdff-e33d-4700-a70a-14207aaa06aa None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:59.621519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:59.622706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:59.622824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:59.623291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:59.626481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.680757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb229d-a0d7-48ae-92a2-054affbdc2eb admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:59.692814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:59.693731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:59.695406 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:59.696397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:59.717698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.808048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:59.837753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:59.842497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:59.871830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 882/1762] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:59.873054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:59.877914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:59.881834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:59.884027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:59.907888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 881/1763] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:59.910233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:59.913076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.062934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc1e3-3a93-4f7e-9c2b-691a8fdd6b88 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:00.069666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:00.071767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:00.072042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:00.072324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:00.079666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.107449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:00.110825 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:00.136312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 883/1764] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:00.139657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:00.142135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.165835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571857b-8f07-484c-b622-ab736ec4b24e service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:00.181440 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:00.182566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:00.183205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:00.183641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] PATH_INFO: `/v3/projects/b59db3bce231430ab0d2678c8dc24bf7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:00.185131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59db3bce231430ab0d2678c8dc24bf7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:00.192947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:00.332741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59db3bce231430ab0d2678c8dc24bf7', 'request_id': 'req-3d0c8dba-e36d-4461-8628-6047cc342ab1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.334439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:00.368723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59db3bce231430ab0d2678c8dc24bf7', 'request_id': 'req-3d0c8dba-e36d-4461-8628-6047cc342ab1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.380924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781f50-be09-4c13-82d1-698da35fbb9c service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:00.386593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59db3bce231430ab0d2678c8dc24bf7', 'request_id': 'req-3d0c8dba-e36d-4461-8628-6047cc342ab1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.413966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] The token cache is being invalidate because project b59db3bce231430ab0d2678c8dc24bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:00.414605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.424570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3d0c8dba-e36d-4461-8628-6047cc342ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:00.434092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 882/1765] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:36:59 2022] DELETE /identity/v3/projects/b59db3bce231430ab0d2678c8dc24bf7 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:00.435683 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a8d6-27d3-4075-a333-a8affaa9bf1b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:00.436179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a8d6-27d3-4075-a333-a8affaa9bf1b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:00.436573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25a8d6-27d3-4075-a333-a8affaa9bf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:00.529045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1f25a8d6-27d3-4075-a333-a8affaa9bf1b None None] MFA Rules not processed for user `ebee38389afb4270b18c6a14c7a4e302`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:00.531759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1f25a8d6-27d3-4075-a333-a8affaa9bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.574606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:00.575359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:00.575635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:00.577443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:00.581903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.697837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:00.710509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 883/1766] 10.222.0.76 () {58 vars in 1015 bytes} [Fri May 27 09:37:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:00.712694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a8d6-27d3-4075-a333-a8affaa9bf1b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:00.720473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1f25a8d6-27d3-4075-a333-a8affaa9bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.826734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:00.833541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:00.883796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 884/1767] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:00.984798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25a8d6-27d3-4075-a333-a8affaa9bf1b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:00.997507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:01.000899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:01.002482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:01.003001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] PATH_INFO: `/v3/users/959ca85abf36442289a03d02ef1d651e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:01.009523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959ca85abf36442289a03d02ef1d651e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:01.012529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:01.032096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:01.040233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:01.091855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f766f5-41bb-4465-ac5f-54284825b920 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:01.108355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:01.111467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:01.111903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:01.113097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:01.116718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959ca85abf36442289a03d02ef1d651e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.149812 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959ca85abf36442289a03d02ef1d651e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.150631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959ca85abf36442289a03d02ef1d651e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.166252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959ca85abf36442289a03d02ef1d651e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.167819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959ca85abf36442289a03d02ef1d651e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:01.199747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 884/1768] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:00 2022] DELETE /identity/v3/users/959ca85abf36442289a03d02ef1d651e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:01.206193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:01.211832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:01.241084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 885/1769] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:02.010303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:02.011856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.030788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:02.036268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:02.039364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.120985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d1ae3-9ecb-4bd3-8336-8362543d8994 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:02.126380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:02.127372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.127722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.128065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] PATH_INFO: `/v3/projects/7c4e2fef00d645f4a9995e510e34ef8a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.130268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4e2fef00d645f4a9995e510e34ef8a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:02.132681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:02.211339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4e2fef00d645f4a9995e510e34ef8a', 'request_id': 'req-7e61f38d-3439-4b22-a94a-a89f9660a270'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.215989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356de7-8986-4ef0-b51a-935eda34bc15 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:02.231727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4e2fef00d645f4a9995e510e34ef8a', 'request_id': 'req-7e61f38d-3439-4b22-a94a-a89f9660a270'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.244051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4e2fef00d645f4a9995e510e34ef8a', 'request_id': 'req-7e61f38d-3439-4b22-a94a-a89f9660a270'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.269932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] The token cache is being invalidate because project 7c4e2fef00d645f4a9995e510e34ef8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:02.270594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.271339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7e61f38d-3439-4b22-a94a-a89f9660a270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.273238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 885/1770] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:02 2022] DELETE /identity/v3/projects/7c4e2fef00d645f4a9995e510e34ef8a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:02.279510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ebe7a-b843-4c75-b805-7c524cdc0a04 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.279888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ebe7a-b843-4c75-b805-7c524cdc0a04 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.280223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ebe7a-b843-4c75-b805-7c524cdc0a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.342331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ee5ebe7a-b843-4c75-b805-7c524cdc0a04 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:02.344801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ee5ebe7a-b843-4c75-b805-7c524cdc0a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.361216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201d8e5-c98b-42ce-92a7-61da170e5a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:02.362445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201d8e5-c98b-42ce-92a7-61da170e5a65 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.362961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201d8e5-c98b-42ce-92a7-61da170e5a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.363409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201d8e5-c98b-42ce-92a7-61da170e5a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.366130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8201d8e5-c98b-42ce-92a7-61da170e5a65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.518900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 886/1771] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:02.520750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ebe7a-b843-4c75-b805-7c524cdc0a04 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:02.526592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ee5ebe7a-b843-4c75-b805-7c524cdc0a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.558582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ebe7a-b843-4c75-b805-7c524cdc0a04 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:02.593086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:02.604807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.606586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.608573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] PATH_INFO: `/v3/projects/7523156002ed4b79a675ff2bfd1e0453` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.612298 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7523156002ed4b79a675ff2bfd1e0453)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:02.622526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:02.632178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201d8e5-c98b-42ce-92a7-61da170e5a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:02.638667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201d8e5-c98b-42ce-92a7-61da170e5a65 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:02.687301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 886/1772] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:02.690870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eeae5-916f-4239-b8b0-4fa3b98c7d97 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.691182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eeae5-916f-4239-b8b0-4fa3b98c7d97 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.693277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eeae5-916f-4239-b8b0-4fa3b98c7d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.796334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:02.808336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a58eeae5-916f-4239-b8b0-4fa3b98c7d97 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:02.809902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a58eeae5-916f-4239-b8b0-4fa3b98c7d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:02.839849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7523156002ed4b79a675ff2bfd1e0453', 'request_id': 'req-663a1182-4a39-4830-bc4f-f6c03be52b59'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.862438 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:02.864247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7523156002ed4b79a675ff2bfd1e0453', 'request_id': 'req-663a1182-4a39-4830-bc4f-f6c03be52b59'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.881099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7523156002ed4b79a675ff2bfd1e0453', 'request_id': 'req-663a1182-4a39-4830-bc4f-f6c03be52b59'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.908791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] The token cache is being invalidate because project 7523156002ed4b79a675ff2bfd1e0453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:02.911471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.913175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663a1182-4a39-4830-bc4f-f6c03be52b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:02.926075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 887/1773] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:02 2022] DELETE /identity/v3/projects/7523156002ed4b79a675ff2bfd1e0453 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:02.930909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501cd44-0c99-48ba-be28-928a88077287 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:02.930909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501cd44-0c99-48ba-be28-928a88077287 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:02.931525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501cd44-0c99-48ba-be28-928a88077287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:02.962729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e501cd44-0c99-48ba-be28-928a88077287 None None] MFA Rules not processed for user `1a3ca370feb4457dbadc476e348ac9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:02.968370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e501cd44-0c99-48ba-be28-928a88077287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:03.032435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 887/1774] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:03.039813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1293a98-7383-40f9-9039-364770959201 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.042737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1293a98-7383-40f9-9039-364770959201 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.043060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1293a98-7383-40f9-9039-364770959201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.114534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f1293a98-7383-40f9-9039-364770959201 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:03.115777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f1293a98-7383-40f9-9039-364770959201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:03.154345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 888/1775] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:03.155736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1293a98-7383-40f9-9039-364770959201 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.198240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1293a98-7383-40f9-9039-364770959201 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.208561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d33be8-44ce-4a95-bd65-c4cd690c9a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.209608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d33be8-44ce-4a95-bd65-c4cd690c9a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.210212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d33be8-44ce-4a95-bd65-c4cd690c9a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.212206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d33be8-44ce-4a95-bd65-c4cd690c9a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.213843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d33be8-44ce-4a95-bd65-c4cd690c9a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:03.214436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d33be8-44ce-4a95-bd65-c4cd690c9a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.217963 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d33be8-44ce-4a95-bd65-c4cd690c9a12 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.242758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 889/1776] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:03.245257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6b1e2-14fa-428b-833a-1f173c297c21 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.245990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6b1e2-14fa-428b-833a-1f173c297c21 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.247171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6b1e2-14fa-428b-833a-1f173c297c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.263727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 888/1777] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:03.272249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501cd44-0c99-48ba-be28-928a88077287 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.279837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a6d6b1e2-14fa-428b-833a-1f173c297c21 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:03.281402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a6d6b1e2-14fa-428b-833a-1f173c297c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:03.317653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 890/1778] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:03.323112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6b1e2-14fa-428b-833a-1f173c297c21 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.350446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6b1e2-14fa-428b-833a-1f173c297c21 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.356518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501cd44-0c99-48ba-be28-928a88077287 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.377712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218db8f-e243-44c8-ae7d-20d4572209fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.378662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218db8f-e243-44c8-ae7d-20d4572209fd admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.379201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218db8f-e243-44c8-ae7d-20d4572209fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.379648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218db8f-e243-44c8-ae7d-20d4572209fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.380511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218db8f-e243-44c8-ae7d-20d4572209fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.389017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218db8f-e243-44c8-ae7d-20d4572209fd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.394044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.394748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.395023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.398930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.398930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:03.398930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.421617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.473386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 891/1779] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:03.475772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.481573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 889/1780] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:03 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:03.486643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218db8f-e243-44c8-ae7d-20d4572209fd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.507014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce72d-a7ae-4e0d-9217-eacc7326b97c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.672247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c695e73-1d99-4b46-85da-7ec51ab16546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.673435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695e73-1d99-4b46-85da-7ec51ab16546 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.673930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695e73-1d99-4b46-85da-7ec51ab16546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.674411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695e73-1d99-4b46-85da-7ec51ab16546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.675485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c695e73-1d99-4b46-85da-7ec51ab16546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.682967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c695e73-1d99-4b46-85da-7ec51ab16546 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.744292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218db8f-e243-44c8-ae7d-20d4572209fd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.774130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 892/1781] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:03 2022] POST /identity/v3/projects => generated 363 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:03.774286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81f665-75c3-4570-95d6-92ad59c03b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.775683 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c695e73-1d99-4b46-85da-7ec51ab16546 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.779129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f665-75c3-4570-95d6-92ad59c03b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.779448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f665-75c3-4570-95d6-92ad59c03b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.780107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f665-75c3-4570-95d6-92ad59c03b08 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.783796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81f665-75c3-4570-95d6-92ad59c03b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.799021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81f665-75c3-4570-95d6-92ad59c03b08 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:03.916187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 890/1782] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:03 2022] POST /identity/v3/users => generated 284 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:03.920984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81f665-75c3-4570-95d6-92ad59c03b08 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:03.956458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c695e73-1d99-4b46-85da-7ec51ab16546 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.975688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede7839-853f-4f11-b49a-b7f46a4355ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:03.976794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede7839-853f-4f11-b49a-b7f46a4355ca admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:03.977330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede7839-853f-4f11-b49a-b7f46a4355ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:03.977805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede7839-853f-4f11-b49a-b7f46a4355ca admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:03.978702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede7839-853f-4f11-b49a-b7f46a4355ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:03.986344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81f665-75c3-4570-95d6-92ad59c03b08 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:03.988264 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede7839-853f-4f11-b49a-b7f46a4355ca admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.019015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d438d0-7fca-46dd-bcdd-5ca2d8de6bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.022777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d438d0-7fca-46dd-bcdd-5ca2d8de6bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.027296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d438d0-7fca-46dd-bcdd-5ca2d8de6bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.027296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d438d0-7fca-46dd-bcdd-5ca2d8de6bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.031640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d438d0-7fca-46dd-bcdd-5ca2d8de6bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.039391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:04.047606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d438d0-7fca-46dd-bcdd-5ca2d8de6bb0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.059161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 893/1783] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:03 2022] POST /identity/v3/users => generated 282 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:04.064594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede7839-853f-4f11-b49a-b7f46a4355ca admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.094987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede7839-853f-4f11-b49a-b7f46a4355ca admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.105543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 891/1784] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:04.109470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d438d0-7fca-46dd-bcdd-5ca2d8de6bb0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.113028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3682b-5a43-4961-aad0-11716a731fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.113820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3682b-5a43-4961-aad0-11716a731fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.114216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3682b-5a43-4961-aad0-11716a731fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.114749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3682b-5a43-4961-aad0-11716a731fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.115508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3682b-5a43-4961-aad0-11716a731fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.118524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3682b-5a43-4961-aad0-11716a731fb8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.143965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 894/1785] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:04.147752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3682b-5a43-4961-aad0-11716a731fb8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.167230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d438d0-7fca-46dd-bcdd-5ca2d8de6bb0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.193588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961ce4e-fad3-4bbf-8589-2c619f4503a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.196415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ce4e-fad3-4bbf-8589-2c619f4503a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.198130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ce4e-fad3-4bbf-8589-2c619f4503a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.198440 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ce4e-fad3-4bbf-8589-2c619f4503a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.200911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961ce4e-fad3-4bbf-8589-2c619f4503a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.205008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3682b-5a43-4961-aad0-11716a731fb8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.205992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961ce4e-fad3-4bbf-8589-2c619f4503a9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.225270 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 892/1786] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:04.230488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961ce4e-fad3-4bbf-8589-2c619f4503a9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.251894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a872-8707-4639-a129-2df820ca4d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.253452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a872-8707-4639-a129-2df820ca4d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.253894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a872-8707-4639-a129-2df820ca4d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.254216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961ce4e-fad3-4bbf-8589-2c619f4503a9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.256217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a872-8707-4639-a129-2df820ca4d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.258888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a872-8707-4639-a129-2df820ca4d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.260718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a872-8707-4639-a129-2df820ca4d29 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.269212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a46f4-b95b-49af-90be-8ceedc4b0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.272220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a46f4-b95b-49af-90be-8ceedc4b0d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.272769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a46f4-b95b-49af-90be-8ceedc4b0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.274684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a46f4-b95b-49af-90be-8ceedc4b0d61 admin admin] PATH_INFO: `/v3/projects/c03987dff4374f239968c8716f7ee4de/users/66904e0e424945c882644ff54c72ecaf/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.290412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:04.325968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a46f4-b95b-49af-90be-8ceedc4b0d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03987dff4374f239968c8716f7ee4de, user_id=66904e0e424945c882644ff54c72ecaf, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.327800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 895/1787] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:04.330065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a46f4-b95b-49af-90be-8ceedc4b0d61 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.331716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a872-8707-4639-a129-2df820ca4d29 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.371603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a872-8707-4639-a129-2df820ca4d29 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.380572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 893/1788] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:04 2022] PUT /identity/v3/projects/c03987dff4374f239968c8716f7ee4de/users/66904e0e424945c882644ff54c72ecaf/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:04.383938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88cfd-41ae-497d-b5b8-50dde5804480 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.384456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88cfd-41ae-497d-b5b8-50dde5804480 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.386105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88cfd-41ae-497d-b5b8-50dde5804480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.515180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1cf88cfd-41ae-497d-b5b8-50dde5804480 None None] MFA Rules not processed for user `66904e0e424945c882644ff54c72ecaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:04.516510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1cf88cfd-41ae-497d-b5b8-50dde5804480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.589033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d79f-a85a-4c8c-9838-314b2f688b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.590140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d79f-a85a-4c8c-9838-314b2f688b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.590431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d79f-a85a-4c8c-9838-314b2f688b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.590712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d79f-a85a-4c8c-9838-314b2f688b79 admin admin] PATH_INFO: `/v3/projects/052f4f16c6e34421989076db83f8c5cd/users/2a5aec742ddb4f469dcc7b2195f35c84/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.653065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517d79f-a85a-4c8c-9838-314b2f688b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=052f4f16c6e34421989076db83f8c5cd, user_id=2a5aec742ddb4f469dcc7b2195f35c84, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.655964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517d79f-a85a-4c8c-9838-314b2f688b79 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.677491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 896/1789] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:04 2022] PUT /identity/v3/projects/052f4f16c6e34421989076db83f8c5cd/users/2a5aec742ddb4f469dcc7b2195f35c84/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:04.691067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddec8-d3c9-4416-99c4-9aea91c0cdd0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.691435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddec8-d3c9-4416-99c4-9aea91c0cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.691634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddec8-d3c9-4416-99c4-9aea91c0cdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.722881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 894/1790] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:04.728526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf88cfd-41ae-497d-b5b8-50dde5804480 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.747127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ac1ddec8-d3c9-4416-99c4-9aea91c0cdd0 None None] MFA Rules not processed for user `2a5aec742ddb4f469dcc7b2195f35c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:04.748450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ac1ddec8-d3c9-4416-99c4-9aea91c0cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.758981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf88cfd-41ae-497d-b5b8-50dde5804480 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.973056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 897/1791] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:04.980770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ddec8-d3c9-4416-99c4-9aea91c0cdd0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.990329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931b945-fb9c-4589-b011-3b685a48d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.991122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931b945-fb9c-4589-b011-3b685a48d782 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.991524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931b945-fb9c-4589-b011-3b685a48d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.991973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931b945-fb9c-4589-b011-3b685a48d782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.992765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931b945-fb9c-4589-b011-3b685a48d782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.994881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931b945-fb9c-4589-b011-3b685a48d782 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.026107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ddec8-d3c9-4416-99c4-9aea91c0cdd0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.054408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6494-9ceb-4c92-a421-5a12ef7d39a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.055386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6494-9ceb-4c92-a421-5a12ef7d39a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.057765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6494-9ceb-4c92-a421-5a12ef7d39a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.058209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6494-9ceb-4c92-a421-5a12ef7d39a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.063867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 895/1792] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/projects => generated 369 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:05.068191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931b945-fb9c-4589-b011-3b685a48d782 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.071106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f6494-9ceb-4c92-a421-5a12ef7d39a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.073676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f6494-9ceb-4c92-a421-5a12ef7d39a0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.199795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 898/1793] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:05.200745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6494-9ceb-4c92-a421-5a12ef7d39a0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.301762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:05.332024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931b945-fb9c-4589-b011-3b685a48d782 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.358536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:05.450917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6494-9ceb-4c92-a421-5a12ef7d39a0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.481703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f050-d703-44dc-a8a9-463d3dac1e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.482340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f050-d703-44dc-a8a9-463d3dac1e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.482626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f050-d703-44dc-a8a9-463d3dac1e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.482901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f050-d703-44dc-a8a9-463d3dac1e21 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.483812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8f050-d703-44dc-a8a9-463d3dac1e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.485808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8f050-d703-44dc-a8a9-463d3dac1e21 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.495241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8751b4-3bb0-442c-826a-9d6d5da27d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.496056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8751b4-3bb0-442c-826a-9d6d5da27d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.515527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8751b4-3bb0-442c-826a-9d6d5da27d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.516052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8751b4-3bb0-442c-826a-9d6d5da27d76 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.516930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8751b4-3bb0-442c-826a-9d6d5da27d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.526935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8751b4-3bb0-442c-826a-9d6d5da27d76 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.567958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 899/1794] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:05 2022] POST /identity/v3/users => generated 288 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:05.568982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f050-d703-44dc-a8a9-463d3dac1e21 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.613729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 896/1795] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:05 2022] POST /identity/v3/users => generated 291 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:05.617729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8751b4-3bb0-442c-826a-9d6d5da27d76 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.626757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f050-d703-44dc-a8a9-463d3dac1e21 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.638542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8751b4-3bb0-442c-826a-9d6d5da27d76 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.649510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b660f-ff29-433f-b7a0-bd03b7c09dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.650249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b660f-ff29-433f-b7a0-bd03b7c09dee admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.650536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b660f-ff29-433f-b7a0-bd03b7c09dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.650821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b660f-ff29-433f-b7a0-bd03b7c09dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.651573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b660f-ff29-433f-b7a0-bd03b7c09dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.665642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6466e4-1a67-4b88-996d-c5c6e1de3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.666333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6466e4-1a67-4b88-996d-c5c6e1de3abb admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.669998 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b660f-ff29-433f-b7a0-bd03b7c09dee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.673857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6466e4-1a67-4b88-996d-c5c6e1de3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.676596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6466e4-1a67-4b88-996d-c5c6e1de3abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.677448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6466e4-1a67-4b88-996d-c5c6e1de3abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.679155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6466e4-1a67-4b88-996d-c5c6e1de3abb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.728479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 900/1796] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:05.736488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b660f-ff29-433f-b7a0-bd03b7c09dee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.756077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 897/1797] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:05.760869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6466e4-1a67-4b88-996d-c5c6e1de3abb admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.797270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b660f-ff29-433f-b7a0-bd03b7c09dee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.817591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801baf23-68bb-4497-af12-4b7ca1f2e6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.818526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801baf23-68bb-4497-af12-4b7ca1f2e6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.818812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801baf23-68bb-4497-af12-4b7ca1f2e6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.819096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801baf23-68bb-4497-af12-4b7ca1f2e6cd admin admin] PATH_INFO: `/v3/projects/ee5e055ecd4c496d9cd9948affee6aa3/users/5c3741233f56490296662bcd4df285b7/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.833443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6466e4-1a67-4b88-996d-c5c6e1de3abb admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:05.885480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cab7bc-24fa-469a-a77b-8dce72f54123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:05.891307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab7bc-24fa-469a-a77b-8dce72f54123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:05.891623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab7bc-24fa-469a-a77b-8dce72f54123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:05.893523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cab7bc-24fa-469a-a77b-8dce72f54123 admin admin] PATH_INFO: `/v3/projects/88167b856d3247efbd45476b3ba57647/users/ee7a20c487f74ae3b4e39b1c8893ec18/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:05.905734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801baf23-68bb-4497-af12-4b7ca1f2e6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5e055ecd4c496d9cd9948affee6aa3, user_id=5c3741233f56490296662bcd4df285b7, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.908456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801baf23-68bb-4497-af12-4b7ca1f2e6cd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:05.951805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 901/1798] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:05 2022] PUT /identity/v3/projects/ee5e055ecd4c496d9cd9948affee6aa3/users/5c3741233f56490296662bcd4df285b7/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:05.953346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801baf23-68bb-4497-af12-4b7ca1f2e6cd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:05.980596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cab7bc-24fa-469a-a77b-8dce72f54123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88167b856d3247efbd45476b3ba57647, user_id=ee7a20c487f74ae3b4e39b1c8893ec18, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:05.997669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cab7bc-24fa-469a-a77b-8dce72f54123 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.073291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 898/1799] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:05 2022] PUT /identity/v3/projects/88167b856d3247efbd45476b3ba57647/users/ee7a20c487f74ae3b4e39b1c8893ec18/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:06.074914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cab7bc-24fa-469a-a77b-8dce72f54123 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:06.113851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801baf23-68bb-4497-af12-4b7ca1f2e6cd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.253424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa02b24-f5b3-4176-af4b-9451327683c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.254469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa02b24-f5b3-4176-af4b-9451327683c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.255673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa02b24-f5b3-4176-af4b-9451327683c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.256850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa02b24-f5b3-4176-af4b-9451327683c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.258794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa02b24-f5b3-4176-af4b-9451327683c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.261854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa02b24-f5b3-4176-af4b-9451327683c2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.295332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 902/1800] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:06.299096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa02b24-f5b3-4176-af4b-9451327683c2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:06.343237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa02b24-f5b3-4176-af4b-9451327683c2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.369572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f1be4-05d8-468a-a1b6-221bb2480180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.370384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f1be4-05d8-468a-a1b6-221bb2480180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.370671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f1be4-05d8-468a-a1b6-221bb2480180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.370956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f1be4-05d8-468a-a1b6-221bb2480180 admin admin] PATH_INFO: `/v3/projects/ee5e055ecd4c496d9cd9948affee6aa3/users/5c3741233f56490296662bcd4df285b7/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.389111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f1be4-05d8-468a-a1b6-221bb2480180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5e055ecd4c496d9cd9948affee6aa3, user_id=5c3741233f56490296662bcd4df285b7, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.394110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cab7bc-24fa-469a-a77b-8dce72f54123 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.403279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f1be4-05d8-468a-a1b6-221bb2480180 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.422111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb72d8-b327-4d74-af1d-94f47cbaca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.429786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb72d8-b327-4d74-af1d-94f47cbaca84 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.432418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb72d8-b327-4d74-af1d-94f47cbaca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.433989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb72d8-b327-4d74-af1d-94f47cbaca84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.434766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb72d8-b327-4d74-af1d-94f47cbaca84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.443472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 903/1801] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:06 2022] PUT /identity/v3/projects/ee5e055ecd4c496d9cd9948affee6aa3/users/5c3741233f56490296662bcd4df285b7/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:06.446547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb72d8-b327-4d74-af1d-94f47cbaca84 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.454178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956c01-6779-4a99-9cfd-cace97b46888 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.454599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956c01-6779-4a99-9cfd-cace97b46888 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.454960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956c01-6779-4a99-9cfd-cace97b46888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.512334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 899/1802] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:06.515890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb72d8-b327-4d74-af1d-94f47cbaca84 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:06.519202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:06.562966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-46956c01-6779-4a99-9cfd-cace97b46888 None None] MFA Rules not processed for user `5c3741233f56490296662bcd4df285b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:06.562966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-46956c01-6779-4a99-9cfd-cace97b46888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.576133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb72d8-b327-4d74-af1d-94f47cbaca84 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.802273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 904/1803] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:06.812059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46956c01-6779-4a99-9cfd-cace97b46888 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:06.813605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-46956c01-6779-4a99-9cfd-cace97b46888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.835274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997580f-8df9-48e8-9519-2eefa10042aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.839717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997580f-8df9-48e8-9519-2eefa10042aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.839717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997580f-8df9-48e8-9519-2eefa10042aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.839717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997580f-8df9-48e8-9519-2eefa10042aa admin admin] PATH_INFO: `/v3/projects/88167b856d3247efbd45476b3ba57647/users/ee7a20c487f74ae3b4e39b1c8893ec18/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.840994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997580f-8df9-48e8-9519-2eefa10042aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=88167b856d3247efbd45476b3ba57647, user_id=ee7a20c487f74ae3b4e39b1c8893ec18, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.844744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997580f-8df9-48e8-9519-2eefa10042aa admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.847879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:06.876946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 900/1804] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:06 2022] PUT /identity/v3/projects/88167b856d3247efbd45476b3ba57647/users/ee7a20c487f74ae3b4e39b1c8893ec18/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:06.887536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57b2a5-75c4-4ca6-b9cb-2e5b23b1ff7d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.887729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57b2a5-75c4-4ca6-b9cb-2e5b23b1ff7d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.888014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57b2a5-75c4-4ca6-b9cb-2e5b23b1ff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.994270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46956c01-6779-4a99-9cfd-cace97b46888 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:07.007221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2f57b2a5-75c4-4ca6-b9cb-2e5b23b1ff7d None None] MFA Rules not processed for user `ee7a20c487f74ae3b4e39b1c8893ec18`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:07.008724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2f57b2a5-75c4-4ca6-b9cb-2e5b23b1ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:07.188571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:07.189314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.189688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.189857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.323657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:07.325188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:07.348982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 905/1805] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:07.376926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 901/1806] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:07.402213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.402887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:07.408219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:07.411637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57b2a5-75c4-4ca6-b9cb-2e5b23b1ff7d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.414439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2f57b2a5-75c4-4ca6-b9cb-2e5b23b1ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:07.451251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57b2a5-75c4-4ca6-b9cb-2e5b23b1ff7d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:07.464938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cabe1-f09a-40d6-8986-0c668bf5b146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:07.465831 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cabe1-f09a-40d6-8986-0c668bf5b146 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.467252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cabe1-f09a-40d6-8986-0c668bf5b146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.467756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cabe1-f09a-40d6-8986-0c668bf5b146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.521353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cabe1-f09a-40d6-8986-0c668bf5b146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:07.523684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cabe1-f09a-40d6-8986-0c668bf5b146 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:07.556297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 902/1807] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:07.649522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cabe1-f09a-40d6-8986-0c668bf5b146 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.661849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6fdd-bea1-4646-83e8-8e9ede9faa6e service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:07.664739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cabe1-f09a-40d6-8986-0c668bf5b146 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:07.673388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:07.673603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:07.674658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.674886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.675390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.675844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] PATH_INFO: `/v3/users/995fa0cda3e140efbf9ec1b33447c145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.675953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.676597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:07.689246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995fa0cda3e140efbf9ec1b33447c145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:07.691273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:07.863960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995fa0cda3e140efbf9ec1b33447c145'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.909961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:07.911503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:07.933542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995fa0cda3e140efbf9ec1b33447c145'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.950860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 903/1808] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:07.951104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995fa0cda3e140efbf9ec1b33447c145'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.951910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995fa0cda3e140efbf9ec1b33447c145'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.952599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f839e5c6-0e3c-4248-b3e6-67c9f6588168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995fa0cda3e140efbf9ec1b33447c145'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:07.955159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:07.964562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:07.984258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 906/1809] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:07 2022] DELETE /identity/v3/users/995fa0cda3e140efbf9ec1b33447c145 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:07.989809 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161e7c-4b2e-4c32-a1cd-776a3a080feb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:07.990084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161e7c-4b2e-4c32-a1cd-776a3a080feb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:07.990870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161e7c-4b2e-4c32-a1cd-776a3a080feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.017171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e1298-dfb8-49b6-92e4-22a2e2cbb778 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:08.038292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b5161e7c-4b2e-4c32-a1cd-776a3a080feb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:08.039775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b5161e7c-4b2e-4c32-a1cd-776a3a080feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:08.283411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 907/1810] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:08.293176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5161e7c-4b2e-4c32-a1cd-776a3a080feb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:08.295811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b5161e7c-4b2e-4c32-a1cd-776a3a080feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:08.380447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:08.439159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:08.443154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.443524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.443862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] PATH_INFO: `/v3/users/f305376f9ee6436ea757f07f8a1241a7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.455102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f305376f9ee6436ea757f07f8a1241a7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:08.471173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:08.496851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:08.505442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5161e7c-4b2e-4c32-a1cd-776a3a080feb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:08.518453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142aa97-141e-4ed7-b11c-63427a00542e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:08.519130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aa97-141e-4ed7-b11c-63427a00542e service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.519425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aa97-141e-4ed7-b11c-63427a00542e service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.519694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aa97-141e-4ed7-b11c-63427a00542e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.556155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142aa97-141e-4ed7-b11c-63427a00542e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:08.557431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142aa97-141e-4ed7-b11c-63427a00542e service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:08.587396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 908/1811] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:08.588857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8c3fe-e13c-4cfc-b339-7873e4810b74 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.589159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8c3fe-e13c-4cfc-b339-7873e4810b74 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.589435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8c3fe-e13c-4cfc-b339-7873e4810b74 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.591106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 909/1812] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:08.622432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2602d-dda5-40b6-ab21-1a74f5fd6180 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.622787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2602d-dda5-40b6-ab21-1a74f5fd6180 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.623075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2602d-dda5-40b6-ab21-1a74f5fd6180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.665308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-96d2602d-dda5-40b6-ab21-1a74f5fd6180 None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:08.666552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-96d2602d-dda5-40b6-ab21-1a74f5fd6180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:08.692185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f305376f9ee6436ea757f07f8a1241a7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:08.716375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f305376f9ee6436ea757f07f8a1241a7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:08.718771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f305376f9ee6436ea757f07f8a1241a7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:08.728914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f305376f9ee6436ea757f07f8a1241a7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:08.731388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0f2db016-2fe2-4a98-9ef8-1432325a327a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f305376f9ee6436ea757f07f8a1241a7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:08.771049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 904/1813] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:07 2022] DELETE /identity/v3/users/f305376f9ee6436ea757f07f8a1241a7 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:08.776090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad389-5c99-4140-ae30-7ca13508af27 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:08.777923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad389-5c99-4140-ae30-7ca13508af27 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:08.778673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad389-5c99-4140-ae30-7ca13508af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:08.856683 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-517ad389-5c99-4140-ae30-7ca13508af27 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:08.858205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-517ad389-5c99-4140-ae30-7ca13508af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:08.936907 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 910/1814] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:09.037065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2602d-dda5-40b6-ab21-1a74f5fd6180 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:09.038643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-96d2602d-dda5-40b6-ab21-1a74f5fd6180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.059509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2602d-dda5-40b6-ab21-1a74f5fd6180 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:09.066699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 905/1815] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:09.072742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:09.073675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:09.073958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:09.074234 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] PATH_INFO: `/v3/users/be5156ed714b4cfcbe894b40c590ba22` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:09.079862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5156ed714b4cfcbe894b40c590ba22)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:09.082132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:09.162231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ad389-5c99-4140-ae30-7ca13508af27 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:09.164435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-517ad389-5c99-4140-ae30-7ca13508af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.278629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5156ed714b4cfcbe894b40c590ba22'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:09.322917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ad389-5c99-4140-ae30-7ca13508af27 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:09.329024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:09.330187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:09.330818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:09.337199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:09.349210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:09.351215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:09.355973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5156ed714b4cfcbe894b40c590ba22'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:09.363854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 906/1816] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:09.377042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5156ed714b4cfcbe894b40c590ba22'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:09.377729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5156ed714b4cfcbe894b40c590ba22'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:09.378393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f357b8f1-87b9-45b2-a580-c15d7aeb4f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5156ed714b4cfcbe894b40c590ba22'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:09.383013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:09.386389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.415252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 911/1817] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:09 2022] DELETE /identity/v3/users/be5156ed714b4cfcbe894b40c590ba22 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:09.424044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d02dc-9f60-4661-a3a6-f60f8a54d87b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:09.424610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d02dc-9f60-4661-a3a6-f60f8a54d87b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:09.424935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d02dc-9f60-4661-a3a6-f60f8a54d87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:09.468091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:09.484909 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-569d02dc-9f60-4661-a3a6-f60f8a54d87b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:09.490903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-569d02dc-9f60-4661-a3a6-f60f8a54d87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.561381 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:09.569290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d54ba-605f-479e-bb10-6fe6f50d9ec0 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:09.641466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 912/1818] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:09.739539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:09.740518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:09.740803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:09.741223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:09.745463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.754218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d02dc-9f60-4661-a3a6-f60f8a54d87b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:09.755822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-569d02dc-9f60-4661-a3a6-f60f8a54d87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:09.817824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:09.818799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:09.871583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 907/1819] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:09.991556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d02dc-9f60-4661-a3a6-f60f8a54d87b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:10.011099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:10.015573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.015923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.016217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.045894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:10.046503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:10.076188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 913/1820] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:11.124121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.125950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.140167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea70074-6b0d-478d-9fb2-5d3683013162 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:11.146635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.148247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.149799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.152377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.153242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.154961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] PATH_INFO: `/v3/users/66904e0e424945c882644ff54c72ecaf` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.156838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=66904e0e424945c882644ff54c72ecaf)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:11.160208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:11.165770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd26143-8ab9-4e8b-9dbd-96bff8f02340 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:11.171806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.172775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.173178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.173559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] PATH_INFO: `/v3/projects/4041625898ed4abf8f5c9f573ee87ba4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.174859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4041625898ed4abf8f5c9f573ee87ba4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:11.176968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:11.242295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4041625898ed4abf8f5c9f573ee87ba4', 'request_id': 'req-0f92576e-646f-445d-8668-16c70a24d763'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.257541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4041625898ed4abf8f5c9f573ee87ba4', 'request_id': 'req-0f92576e-646f-445d-8668-16c70a24d763'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.266680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4041625898ed4abf8f5c9f573ee87ba4', 'request_id': 'req-0f92576e-646f-445d-8668-16c70a24d763'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.283791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66904e0e424945c882644ff54c72ecaf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.293193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] The token cache is being invalidate because project 4041625898ed4abf8f5c9f573ee87ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:11.293437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.295216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.296822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 914/1821] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:11 2022] DELETE /identity/v3/projects/4041625898ed4abf8f5c9f573ee87ba4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:11.297794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.299110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.311302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66904e0e424945c882644ff54c72ecaf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.312237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66904e0e424945c882644ff54c72ecaf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.320907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66904e0e424945c882644ff54c72ecaf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.322192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-fba6c081-c2c1-47e1-9a82-125608768c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66904e0e424945c882644ff54c72ecaf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.339106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 908/1822] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:11 2022] DELETE /identity/v3/users/66904e0e424945c882644ff54c72ecaf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:11.340937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece11b-551b-4672-9a22-8765c7162e8f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.341373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece11b-551b-4672-9a22-8765c7162e8f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.341889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece11b-551b-4672-9a22-8765c7162e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.365622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-81ece11b-551b-4672-9a22-8765c7162e8f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:11.367003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-81ece11b-551b-4672-9a22-8765c7162e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.390820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:11.444979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:11.452839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92576e-646f-445d-8668-16c70a24d763 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:11.504665 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 909/1823] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:11.508970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3fd7-9d42-42bb-bff4-ac6ce00eecdb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.509373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3fd7-9d42-42bb-bff4-ac6ce00eecdb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.509729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c3fd7-9d42-42bb-bff4-ac6ce00eecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.534257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c88c3fd7-9d42-42bb-bff4-ac6ce00eecdb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:11.536886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c88c3fd7-9d42-42bb-bff4-ac6ce00eecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.550605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 910/1824] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:11.551790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c3fd7-9d42-42bb-bff4-ac6ce00eecdb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.553587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c88c3fd7-9d42-42bb-bff4-ac6ce00eecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.570160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c3fd7-9d42-42bb-bff4-ac6ce00eecdb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:11.575622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.576610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.577052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.577832 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] PATH_INFO: `/v3/projects/2c34fdcef7ee430faea757110cde49a2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.579509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c34fdcef7ee430faea757110cde49a2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:11.581610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:11.663100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.663100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.663100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.663100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] PATH_INFO: `/v3/projects/78ac6f53b75b4719b76f95d23da83859` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.664210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ac6f53b75b4719b76f95d23da83859)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:11.664210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:11.674714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c34fdcef7ee430faea757110cde49a2', 'request_id': 'req-58ba40f7-fefe-4576-a7f7-210c28ef7509'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.684019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c34fdcef7ee430faea757110cde49a2', 'request_id': 'req-58ba40f7-fefe-4576-a7f7-210c28ef7509'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.692989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c34fdcef7ee430faea757110cde49a2', 'request_id': 'req-58ba40f7-fefe-4576-a7f7-210c28ef7509'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.714930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] The token cache is being invalidate because project 2c34fdcef7ee430faea757110cde49a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:11.716042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.716841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-58ba40f7-fefe-4576-a7f7-210c28ef7509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.722280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 911/1825] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:11 2022] DELETE /identity/v3/projects/2c34fdcef7ee430faea757110cde49a2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:11.723774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc379b18-f890-4468-84c0-0ba0f9e0b103 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.724239 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc379b18-f890-4468-84c0-0ba0f9e0b103 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.724543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc379b18-f890-4468-84c0-0ba0f9e0b103 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.728892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 912/1826] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:11.762189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4f88-19b5-4094-8ada-c524e0f0b89c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.762489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4f88-19b5-4094-8ada-c524e0f0b89c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.766323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4f88-19b5-4094-8ada-c524e0f0b89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.775975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ac6f53b75b4719b76f95d23da83859', 'request_id': 'req-029bf789-b39b-4e03-b7b6-155b4d2e08b4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.782124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ac6f53b75b4719b76f95d23da83859', 'request_id': 'req-029bf789-b39b-4e03-b7b6-155b4d2e08b4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.799561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ac6f53b75b4719b76f95d23da83859', 'request_id': 'req-029bf789-b39b-4e03-b7b6-155b4d2e08b4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.807848 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fb1c4f88-19b5-4094-8ada-c524e0f0b89c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:11.809375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fb1c4f88-19b5-4094-8ada-c524e0f0b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.824192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] The token cache is being invalidate because project 78ac6f53b75b4719b76f95d23da83859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:11.824585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.825710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:11.828123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 915/1827] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:11 2022] DELETE /identity/v3/projects/78ac6f53b75b4719b76f95d23da83859 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:11.829332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.832356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.949339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bf789-b39b-4e03-b7b6-155b4d2e08b4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:11.953306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c26529-48ac-490b-9b0e-efd0752f35f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:11.954495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26529-48ac-490b-9b0e-efd0752f35f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:11.954821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26529-48ac-490b-9b0e-efd0752f35f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:11.955079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26529-48ac-490b-9b0e-efd0752f35f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:11.957327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-56c26529-48ac-490b-9b0e-efd0752f35f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:11.987465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 913/1828] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:11.988576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c4f88-19b5-4094-8ada-c524e0f0b89c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:11.992985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fb1c4f88-19b5-4094-8ada-c524e0f0b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.013097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c4f88-19b5-4094-8ada-c524e0f0b89c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.021553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:12.025608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.026847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.027133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.027411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] PATH_INFO: `/v3/users/533fd6db210a42cca9a54959f6049c13` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.032410 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533fd6db210a42cca9a54959f6049c13)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.036094 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.057423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c26529-48ac-490b-9b0e-efd0752f35f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.060527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c26529-48ac-490b-9b0e-efd0752f35f0 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.103571 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:12.108959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 916/1829] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:12.113977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbed12f-41bc-4708-bdc1-bd22460366fb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.114309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbed12f-41bc-4708-bdc1-bd22460366fb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.114585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbed12f-41bc-4708-bdc1-bd22460366fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.118025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533fd6db210a42cca9a54959f6049c13'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.139478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533fd6db210a42cca9a54959f6049c13'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.141155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533fd6db210a42cca9a54959f6049c13'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.156430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533fd6db210a42cca9a54959f6049c13'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.159126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533fd6db210a42cca9a54959f6049c13'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.163186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7dbed12f-41bc-4708-bdc1-bd22460366fb None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:12.164534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7dbed12f-41bc-4708-bdc1-bd22460366fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.203414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 914/1830] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:11 2022] DELETE /identity/v3/users/533fd6db210a42cca9a54959f6049c13 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:12.204428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.207448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.270713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 917/1831] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:12.271885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbed12f-41bc-4708-bdc1-bd22460366fb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.273137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7dbed12f-41bc-4708-bdc1-bd22460366fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.291014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbed12f-41bc-4708-bdc1-bd22460366fb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.332772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112665cb-85ac-44d5-9e41-8792920eddf5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.339010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.340227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.340661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.341132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] PATH_INFO: `/v3/users/7d0e0bb5f0b64865bdfc3434abe844df` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.343084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0e0bb5f0b64865bdfc3434abe844df)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.345879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.358654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.359477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.359828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.360156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.360892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:12.361320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.363130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.394652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 918/1832] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:12.397123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.399688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.416419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0e0bb5f0b64865bdfc3434abe844df'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.431052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0e0bb5f0b64865bdfc3434abe844df'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.431941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0e0bb5f0b64865bdfc3434abe844df'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.441927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0e0bb5f0b64865bdfc3434abe844df'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.443046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0e0bb5f0b64865bdfc3434abe844df'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:12.459673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 915/1833] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:12 2022] DELETE /identity/v3/users/7d0e0bb5f0b64865bdfc3434abe844df => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:12.460801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.463084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.528559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:12.567957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cde4-2073-456b-9b3d-fc53904083e0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.574188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:12.595207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acad3e-a184-481e-829a-11ea8ce6b427 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.609090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a65f62-b82a-4e0b-83d5-63d8ba4280b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.609956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65f62-b82a-4e0b-83d5-63d8ba4280b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.610251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65f62-b82a-4e0b-83d5-63d8ba4280b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.610523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65f62-b82a-4e0b-83d5-63d8ba4280b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.611238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a65f62-b82a-4e0b-83d5-63d8ba4280b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.618631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a65f62-b82a-4e0b-83d5-63d8ba4280b2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.678727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 916/1834] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:12 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:12.680962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a65f62-b82a-4e0b-83d5-63d8ba4280b2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.691991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.693201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.693646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.694091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.697752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:12.713935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.715739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.742721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 919/1835] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:12.800117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a65f62-b82a-4e0b-83d5-63d8ba4280b2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.809012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8a89b-3dc3-4411-a19c-759ebf14db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.809898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a89b-3dc3-4411-a19c-759ebf14db31 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.810184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a89b-3dc3-4411-a19c-759ebf14db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.810609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a89b-3dc3-4411-a19c-759ebf14db31 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.811322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a89b-3dc3-4411-a19c-759ebf14db31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.813501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a89b-3dc3-4411-a19c-759ebf14db31 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.841730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 917/1836] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:12 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:12.845827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.861526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832933-6c01-4904-b28e-bb8631def4ce service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.870153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc96044-16a0-49a6-a411-11234a983ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.872733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc96044-16a0-49a6-a411-11234a983ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.873194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc96044-16a0-49a6-a411-11234a983ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.873634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc96044-16a0-49a6-a411-11234a983ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.874814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc96044-16a0-49a6-a411-11234a983ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.890790 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc96044-16a0-49a6-a411-11234a983ea5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.922669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 920/1837] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:12.922891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8a89b-3dc3-4411-a19c-759ebf14db31 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.941547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8a89b-3dc3-4411-a19c-759ebf14db31 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.950219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.950930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.951736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.952021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:12.952792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:12.955668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:12.973799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 918/1838] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:12.976560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc96044-16a0-49a6-a411-11234a983ea5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:12.989216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc96044-16a0-49a6-a411-11234a983ea5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:12.994811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711d22c-3246-4a50-bdd9-a67fe45ae568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:12.995845 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711d22c-3246-4a50-bdd9-a67fe45ae568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:12.996195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711d22c-3246-4a50-bdd9-a67fe45ae568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:12.996549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711d22c-3246-4a50-bdd9-a67fe45ae568 admin admin] PATH_INFO: `/v3/projects/5293855828ee441a84fc0d256c838b68/users/01302a0b18c94db38aa723735734e5d5/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.031631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711d22c-3246-4a50-bdd9-a67fe45ae568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5293855828ee441a84fc0d256c838b68, user_id=01302a0b18c94db38aa723735734e5d5, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.036244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711d22c-3246-4a50-bdd9-a67fe45ae568 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.051750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.055507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.102407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 921/1839] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:12 2022] PUT /identity/v3/projects/5293855828ee441a84fc0d256c838b68/users/01302a0b18c94db38aa723735734e5d5/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:13.108038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc03671-d478-4cff-9e69-42a3ebdc74fd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.114340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381aac-9c48-4cbf-a19f-3b37efe68ce2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.114775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381aac-9c48-4cbf-a19f-3b37efe68ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.115269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381aac-9c48-4cbf-a19f-3b37efe68ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.201274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5d381aac-9c48-4cbf-a19f-3b37efe68ce2 None None] MFA Rules not processed for user `01302a0b18c94db38aa723735734e5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:13.202706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5d381aac-9c48-4cbf-a19f-3b37efe68ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.262124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.263012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.263420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.263605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] PATH_INFO: `/v3/projects/96c8fab93b8e43a596b3596004c78119` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.265354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c8fab93b8e43a596b3596004c78119)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.272728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.326889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:13.341315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c8fab93b8e43a596b3596004c78119', 'request_id': 'req-c2550d14-f82d-4cad-b025-63cf3d2c70a0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.344485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 922/1840] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:13.348486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d381aac-9c48-4cbf-a19f-3b37efe68ce2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.350644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c8fab93b8e43a596b3596004c78119', 'request_id': 'req-c2550d14-f82d-4cad-b025-63cf3d2c70a0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.360194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c8fab93b8e43a596b3596004c78119', 'request_id': 'req-c2550d14-f82d-4cad-b025-63cf3d2c70a0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.374245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d381aac-9c48-4cbf-a19f-3b37efe68ce2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.390673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] The token cache is being invalidate because project 96c8fab93b8e43a596b3596004c78119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:13.391658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.393776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.399407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 919/1841] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:13 2022] DELETE /identity/v3/projects/96c8fab93b8e43a596b3596004c78119 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:13.399407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.401002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.459841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:13.484506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a09bcb-2eb5-4639-819c-60ecc594c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.486074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a09bcb-2eb5-4639-819c-60ecc594c951 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.486573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a09bcb-2eb5-4639-819c-60ecc594c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.486896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a09bcb-2eb5-4639-819c-60ecc594c951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.487866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a09bcb-2eb5-4639-819c-60ecc594c951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.490469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a09bcb-2eb5-4639-819c-60ecc594c951 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.503048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2550d14-f82d-4cad-b025-63cf3d2c70a0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.510456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.511450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.511733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.512053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] PATH_INFO: `/v3/projects/c03987dff4374f239968c8716f7ee4de` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.514541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03987dff4374f239968c8716f7ee4de)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.516971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.532374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 923/1842] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:13.534452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793013e2-718c-488a-9d08-805577074bd6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.534452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793013e2-718c-488a-9d08-805577074bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.534754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793013e2-718c-488a-9d08-805577074bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.566751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-793013e2-718c-488a-9d08-805577074bd6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:13.568245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-793013e2-718c-488a-9d08-805577074bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.584320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03987dff4374f239968c8716f7ee4de', 'request_id': 'req-a0bdddda-7e7c-4e05-a992-5501fe3be636'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.593288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03987dff4374f239968c8716f7ee4de', 'request_id': 'req-a0bdddda-7e7c-4e05-a992-5501fe3be636'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.600901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03987dff4374f239968c8716f7ee4de', 'request_id': 'req-a0bdddda-7e7c-4e05-a992-5501fe3be636'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.619643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] The token cache is being invalidate because project c03987dff4374f239968c8716f7ee4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:13.620175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.621287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.623124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 920/1843] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:13 2022] DELETE /identity/v3/projects/c03987dff4374f239968c8716f7ee4de => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:13.624177 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.625689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.664138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 924/1844] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:13.664138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793013e2-718c-488a-9d08-805577074bd6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.664138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-793013e2-718c-488a-9d08-805577074bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.680606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793013e2-718c-488a-9d08-805577074bd6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.687133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.688076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.688423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.688777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] PATH_INFO: `/v3/users/ee7a20c487f74ae3b4e39b1c8893ec18` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.690125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7a20c487f74ae3b4e39b1c8893ec18)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.692175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.713850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:13.718240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdddda-7e7c-4e05-a992-5501fe3be636 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.730092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.730977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.731308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.731730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.732585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.735683 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.764011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7a20c487f74ae3b4e39b1c8893ec18'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.772975 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 921/1845] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:13.773299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.775130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.785322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7a20c487f74ae3b4e39b1c8893ec18'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.790091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95ada-4c14-43c9-841b-5d10a0f07a5d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.795249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7a20c487f74ae3b4e39b1c8893ec18'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.796189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7a20c487f74ae3b4e39b1c8893ec18'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.797173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.797714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-138629d2-8a7e-4b5a-88cb-be2d6784b0bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7a20c487f74ae3b4e39b1c8893ec18'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.798298 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.798674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.799064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] PATH_INFO: `/v3/projects/39ff471c0cfa4854a69d20d8e24b78eb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.800443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ff471c0cfa4854a69d20d8e24b78eb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.802615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.815648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 925/1846] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:13 2022] DELETE /identity/v3/users/ee7a20c487f74ae3b4e39b1c8893ec18 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:13.817073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ae4a9-d51f-4b22-879f-070ceefbdf22 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.817364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ae4a9-d51f-4b22-879f-070ceefbdf22 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.817645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ae4a9-d51f-4b22-879f-070ceefbdf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.839249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c86ae4a9-d51f-4b22-879f-070ceefbdf22 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:13.843042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c86ae4a9-d51f-4b22-879f-070ceefbdf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.868400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ff471c0cfa4854a69d20d8e24b78eb', 'request_id': 'req-790743ff-1e2d-4a57-b844-9ae01801b115'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.876170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ff471c0cfa4854a69d20d8e24b78eb', 'request_id': 'req-790743ff-1e2d-4a57-b844-9ae01801b115'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.883552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ff471c0cfa4854a69d20d8e24b78eb', 'request_id': 'req-790743ff-1e2d-4a57-b844-9ae01801b115'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.894564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:13.900387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] The token cache is being invalidate because project 39ff471c0cfa4854a69d20d8e24b78eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:13.900678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.901565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:13.906735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 922/1847] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:13 2022] DELETE /identity/v3/projects/39ff471c0cfa4854a69d20d8e24b78eb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:13.907868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.909418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.934964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 926/1848] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:13.934964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b68c-d505-4107-94d2-78075d7c3f84 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.934964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b68c-d505-4107-94d2-78075d7c3f84 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.934964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b68c-d505-4107-94d2-78075d7c3f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.959678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9a93b68c-d505-4107-94d2-78075d7c3f84 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:13.961042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9a93b68c-d505-4107-94d2-78075d7c3f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.994766 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790743ff-1e2d-4a57-b844-9ae01801b115 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.998880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51e45-aacd-4074-8cc1-94bc2aae85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.999680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51e45-aacd-4074-8cc1-94bc2aae85c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.000063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51e45-aacd-4074-8cc1-94bc2aae85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.000442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51e45-aacd-4074-8cc1-94bc2aae85c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.001328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a51e45-aacd-4074-8cc1-94bc2aae85c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.003034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a51e45-aacd-4074-8cc1-94bc2aae85c9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.017030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 923/1849] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:14.017030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51e45-aacd-4074-8cc1-94bc2aae85c9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.026093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51e45-aacd-4074-8cc1-94bc2aae85c9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.034989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.035831 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.036224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.036798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.037637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:14.038056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.040413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.062232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 924/1850] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:14.063248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.072348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 927/1851] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:14.073373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b68c-d505-4107-94d2-78075d7c3f84 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.084667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b68c-d505-4107-94d2-78075d7c3f84 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.090607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5a06c-3f48-4589-ac33-ad55d0c12070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.091905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a06c-3f48-4589-ac33-ad55d0c12070 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.092466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5446df-0f5f-4574-843c-31018d231d1f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.092587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a06c-3f48-4589-ac33-ad55d0c12070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.092782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a06c-3f48-4589-ac33-ad55d0c12070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.093628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5a06c-3f48-4589-ac33-ad55d0c12070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.095586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5a06c-3f48-4589-ac33-ad55d0c12070 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.109147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd940d-44cc-4282-b2ce-e8b8fcfbbfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.109147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd940d-44cc-4282-b2ce-e8b8fcfbbfe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.109147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd940d-44cc-4282-b2ce-e8b8fcfbbfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.109147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd940d-44cc-4282-b2ce-e8b8fcfbbfe0 admin admin] PATH_INFO: `/v3/projects/cfe1fe0371f24819a1dae4b36839020b/users/e55fff82b26540c19a5ef261cb5745e2/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.132360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd940d-44cc-4282-b2ce-e8b8fcfbbfe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe1fe0371f24819a1dae4b36839020b, user_id=e55fff82b26540c19a5ef261cb5745e2, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.135465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd940d-44cc-4282-b2ce-e8b8fcfbbfe0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.141912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 928/1852] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:14.144416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ace31-1fd2-41dd-bab6-2cecc06b5f08 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.144416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ace31-1fd2-41dd-bab6-2cecc06b5f08 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.144636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ace31-1fd2-41dd-bab6-2cecc06b5f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.157629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 925/1853] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:14 2022] PUT /identity/v3/projects/cfe1fe0371f24819a1dae4b36839020b/users/e55fff82b26540c19a5ef261cb5745e2/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:14.157629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd940d-44cc-4282-b2ce-e8b8fcfbbfe0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.173183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f71ace31-1fd2-41dd-bab6-2cecc06b5f08 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:14.174491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f71ace31-1fd2-41dd-bab6-2cecc06b5f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:14.191854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:14.231452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd940d-44cc-4282-b2ce-e8b8fcfbbfe0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.237695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b348dbc-3fe3-4c34-b763-b4b87bcdcee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.238476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348dbc-3fe3-4c34-b763-b4b87bcdcee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.238830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348dbc-3fe3-4c34-b763-b4b87bcdcee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.239174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348dbc-3fe3-4c34-b763-b4b87bcdcee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.240862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b348dbc-3fe3-4c34-b763-b4b87bcdcee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.243480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b348dbc-3fe3-4c34-b763-b4b87bcdcee8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.269566 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 929/1854] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:14.270764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ace31-1fd2-41dd-bab6-2cecc06b5f08 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.286139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ace31-1fd2-41dd-bab6-2cecc06b5f08 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.303611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 926/1855] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:14.305681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b348dbc-3fe3-4c34-b763-b4b87bcdcee8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.309764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe73e2-39d1-4fc8-938f-3a6e8a540fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.310470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe73e2-39d1-4fc8-938f-3a6e8a540fed admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.310757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe73e2-39d1-4fc8-938f-3a6e8a540fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.311035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe73e2-39d1-4fc8-938f-3a6e8a540fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.312294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe73e2-39d1-4fc8-938f-3a6e8a540fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.315384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe73e2-39d1-4fc8-938f-3a6e8a540fed admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.323726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b348dbc-3fe3-4c34-b763-b4b87bcdcee8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.330778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.331750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 930/1856] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:14.332043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.332530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.333081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.333630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe73e2-39d1-4fc8-938f-3a6e8a540fed admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.334864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:14.336140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.343445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.349660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe73e2-39d1-4fc8-938f-3a6e8a540fed admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.366374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 927/1857] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:14.367598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.374700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414badef-16f0-4d98-9e9d-fe337c72074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.375512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414badef-16f0-4d98-9e9d-fe337c72074d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.375890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414badef-16f0-4d98-9e9d-fe337c72074d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.376411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414badef-16f0-4d98-9e9d-fe337c72074d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.377403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414badef-16f0-4d98-9e9d-fe337c72074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.379984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414badef-16f0-4d98-9e9d-fe337c72074d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.389709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea387b3-9745-4eb0-a7e0-4e08ceae7374 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.403960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a338234-d59a-4138-a788-137b741a176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.405046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338234-d59a-4138-a788-137b741a176b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.405462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338234-d59a-4138-a788-137b741a176b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.405840 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338234-d59a-4138-a788-137b741a176b admin admin] PATH_INFO: `/v3/projects/cfe1fe0371f24819a1dae4b36839020b/users/e55fff82b26540c19a5ef261cb5745e2/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.407806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 931/1858] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:14.408801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414badef-16f0-4d98-9e9d-fe337c72074d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.410436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a338234-d59a-4138-a788-137b741a176b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe1fe0371f24819a1dae4b36839020b, user_id=e55fff82b26540c19a5ef261cb5745e2, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.418947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a338234-d59a-4138-a788-137b741a176b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.434008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414badef-16f0-4d98-9e9d-fe337c72074d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.463713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 928/1859] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:14 2022] PUT /identity/v3/projects/cfe1fe0371f24819a1dae4b36839020b/users/e55fff82b26540c19a5ef261cb5745e2/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:14.466286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a338234-d59a-4138-a788-137b741a176b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.544287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:14.593397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2688a39-8078-4ef1-92dd-ba9df7c9c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.594084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688a39-8078-4ef1-92dd-ba9df7c9c3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.594367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688a39-8078-4ef1-92dd-ba9df7c9c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.594645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688a39-8078-4ef1-92dd-ba9df7c9c3ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.595338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2688a39-8078-4ef1-92dd-ba9df7c9c3ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.599006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2688a39-8078-4ef1-92dd-ba9df7c9c3ee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.604070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a338234-d59a-4138-a788-137b741a176b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.613832 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5021e-e5c6-42a7-a3b2-3ab3c9331ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.614517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5021e-e5c6-42a7-a3b2-3ab3c9331ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.614798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5021e-e5c6-42a7-a3b2-3ab3c9331ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.615071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5021e-e5c6-42a7-a3b2-3ab3c9331ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.615798 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5021e-e5c6-42a7-a3b2-3ab3c9331ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.621484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5021e-e5c6-42a7-a3b2-3ab3c9331ac3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.649740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 929/1860] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:14.658450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dbd26-2327-4bc9-967d-0bb14a1eeeb6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.658761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dbd26-2327-4bc9-967d-0bb14a1eeeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.659113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dbd26-2327-4bc9-967d-0bb14a1eeeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.670074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 932/1861] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/projects => generated 381 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:14.675732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2688a39-8078-4ef1-92dd-ba9df7c9c3ee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.713699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-485dbd26-2327-4bc9-967d-0bb14a1eeeb6 None None] MFA Rules not processed for user `e55fff82b26540c19a5ef261cb5745e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:14.715404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-485dbd26-2327-4bc9-967d-0bb14a1eeeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:14.802586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2688a39-8078-4ef1-92dd-ba9df7c9c3ee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.810563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.812792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.813707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.814123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] PATH_INFO: `/v3/projects/44f530d097d545beb5dca50f7a077657/users/5938716e983f4163a149636d7ea2ec3f/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.837402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f530d097d545beb5dca50f7a077657, user_id=5938716e983f4163a149636d7ea2ec3f, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.842774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.845964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 930/1862] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:14.847149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dbd26-2327-4bc9-967d-0bb14a1eeeb6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.862729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 933/1863] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:14 2022] PUT /identity/v3/projects/44f530d097d545beb5dca50f7a077657/users/5938716e983f4163a149636d7ea2ec3f/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:14.863781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dbd26-2327-4bc9-967d-0bb14a1eeeb6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.864233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:14.866660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:14.881688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:14.964727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735854-935b-4fc1-9c34-f4a102106685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.965505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735854-935b-4fc1-9c34-f4a102106685 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.965900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735854-935b-4fc1-9c34-f4a102106685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.966376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735854-935b-4fc1-9c34-f4a102106685 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:14.967597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735854-935b-4fc1-9c34-f4a102106685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:14.970428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735854-935b-4fc1-9c34-f4a102106685 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:14.975044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad4ce-02b6-43fe-9060-48b38756da0a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:14.980977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0fc87-3194-4db7-9716-4ffa3149c2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:14.995743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0fc87-3194-4db7-9716-4ffa3149c2be service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:14.997421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0fc87-3194-4db7-9716-4ffa3149c2be service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:14.998505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0fc87-3194-4db7-9716-4ffa3149c2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.005390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 931/1864] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:14 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:15.007569 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa9bb-b548-448a-b00a-ca16c68093a8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.008095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa9bb-b548-448a-b00a-ca16c68093a8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.008923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa9bb-b548-448a-b00a-ca16c68093a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.057878 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-276aa9bb-b548-448a-b00a-ca16c68093a8 None None] MFA Rules not processed for user `5938716e983f4163a149636d7ea2ec3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:15.062353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-276aa9bb-b548-448a-b00a-ca16c68093a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.122474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0fc87-3194-4db7-9716-4ffa3149c2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.124682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0fc87-3194-4db7-9716-4ffa3149c2be service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.131109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:15.137802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 934/1865] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:15.138884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0fc87-3194-4db7-9716-4ffa3149c2be service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.150444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0fc87-3194-4db7-9716-4ffa3149c2be service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.157099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebe724-edd1-465f-8d33-3fc5fee58ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.157789 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebe724-edd1-465f-8d33-3fc5fee58ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.158076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebe724-edd1-465f-8d33-3fc5fee58ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.158367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebe724-edd1-465f-8d33-3fc5fee58ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.159276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebe724-edd1-465f-8d33-3fc5fee58ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.160921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebe724-edd1-465f-8d33-3fc5fee58ce5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.186102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 932/1866] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:15.187499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa9bb-b548-448a-b00a-ca16c68093a8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.193141 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-276aa9bb-b548-448a-b00a-ca16c68093a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.194292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 935/1867] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:15.195750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebe724-edd1-465f-8d33-3fc5fee58ce5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.215242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebe724-edd1-465f-8d33-3fc5fee58ce5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.223943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.225107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.225406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.226410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] PATH_INFO: `/v3/users/01302a0b18c94db38aa723735734e5d5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.227815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01302a0b18c94db38aa723735734e5d5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.230202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.238863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa9bb-b548-448a-b00a-ca16c68093a8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.256487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.262023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.262527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.262993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] PATH_INFO: `/v3/projects/88167b856d3247efbd45476b3ba57647` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.269997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88167b856d3247efbd45476b3ba57647)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.280126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.344083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01302a0b18c94db38aa723735734e5d5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.357689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01302a0b18c94db38aa723735734e5d5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.367405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01302a0b18c94db38aa723735734e5d5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.368127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01302a0b18c94db38aa723735734e5d5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.368869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01302a0b18c94db38aa723735734e5d5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.370249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88167b856d3247efbd45476b3ba57647', 'request_id': 'req-a99095da-c79d-4078-86d9-ec475d914c07'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.379095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88167b856d3247efbd45476b3ba57647', 'request_id': 'req-a99095da-c79d-4078-86d9-ec475d914c07'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.386431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88167b856d3247efbd45476b3ba57647', 'request_id': 'req-a99095da-c79d-4078-86d9-ec475d914c07'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.394569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 936/1868] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:15 2022] DELETE /identity/v3/users/01302a0b18c94db38aa723735734e5d5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:15.395642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.397992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.403197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] The token cache is being invalidate because project 88167b856d3247efbd45476b3ba57647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:15.403643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.404414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:15.406899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 933/1869] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:15 2022] DELETE /identity/v3/projects/88167b856d3247efbd45476b3ba57647 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:15.408598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.410406 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.433846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:15.481337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc80d1-03a9-4da2-8f8b-0350b3581eb4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.486210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949874-9848-4939-97f6-b972e4e829d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.486963 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949874-9848-4939-97f6-b972e4e829d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.487316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949874-9848-4939-97f6-b972e4e829d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.487685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949874-9848-4939-97f6-b972e4e829d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.488454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1949874-9848-4939-97f6-b972e4e829d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.490800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1949874-9848-4939-97f6-b972e4e829d7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.516046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99095da-c79d-4078-86d9-ec475d914c07 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.522121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9024-b565-4533-8695-248c753928ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.523666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9024-b565-4533-8695-248c753928ae admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.524161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9024-b565-4533-8695-248c753928ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.524514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9024-b565-4533-8695-248c753928ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.525302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 937/1870] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:15 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:15.526679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61d5c4-1e2b-4882-baee-451563a093ea None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.527031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61d5c4-1e2b-4882-baee-451563a093ea None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.527395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61d5c4-1e2b-4882-baee-451563a093ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.529270 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f9024-b565-4533-8695-248c753928ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.531085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f9024-b565-4533-8695-248c753928ae admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.548741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7f61d5c4-1e2b-4882-baee-451563a093ea None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:15.549006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 934/1871] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:15.549946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7f61d5c4-1e2b-4882-baee-451563a093ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.550722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916390e-d9a6-4389-8031-d8198e5e6db9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.551087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916390e-d9a6-4389-8031-d8198e5e6db9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.551438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916390e-d9a6-4389-8031-d8198e5e6db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.576679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5916390e-d9a6-4389-8031-d8198e5e6db9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:15.578200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5916390e-d9a6-4389-8031-d8198e5e6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.621979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:15.656428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 935/1872] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:15.657425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916390e-d9a6-4389-8031-d8198e5e6db9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.658814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5916390e-d9a6-4389-8031-d8198e5e6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.669000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 938/1873] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:15.669665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61d5c4-1e2b-4882-baee-451563a093ea None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.677276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916390e-d9a6-4389-8031-d8198e5e6db9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.684205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84397fc7-34cc-442b-84b0-948913b6cd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.685014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397fc7-34cc-442b-84b0-948913b6cd16 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.685497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397fc7-34cc-442b-84b0-948913b6cd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.686533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397fc7-34cc-442b-84b0-948913b6cd16 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.689518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84397fc7-34cc-442b-84b0-948913b6cd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.692420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84397fc7-34cc-442b-84b0-948913b6cd16 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.693385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61d5c4-1e2b-4882-baee-451563a093ea None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.709828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc64b34-73f9-438d-b860-ae81308e37b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.711641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64b34-73f9-438d-b860-ae81308e37b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.711955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64b34-73f9-438d-b860-ae81308e37b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.712243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64b34-73f9-438d-b860-ae81308e37b6 admin admin] PATH_INFO: `/v3/projects/55bfc0b8c32b4f4c8c729308f2315669/users/0bf215f89d1a41bb9aca92b106c2b015/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.738566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 936/1874] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:15 2022] POST /identity/v3/users => generated 300 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:15.738566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1e25-10f4-4b93-8d41-7a92d054ebc9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.738566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1e25-10f4-4b93-8d41-7a92d054ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.738566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1e25-10f4-4b93-8d41-7a92d054ebc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:15.749727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc64b34-73f9-438d-b860-ae81308e37b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bfc0b8c32b4f4c8c729308f2315669, user_id=0bf215f89d1a41bb9aca92b106c2b015, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:15.753060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc64b34-73f9-438d-b860-ae81308e37b6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:15.767484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-52af1e25-10f4-4b93-8d41-7a92d054ebc9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:15.768974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-52af1e25-10f4-4b93-8d41-7a92d054ebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.782263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 937/1875] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:15.782263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af1e25-10f4-4b93-8d41-7a92d054ebc9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.785692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-52af1e25-10f4-4b93-8d41-7a92d054ebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:15.831807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 939/1876] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:15 2022] PUT /identity/v3/projects/55bfc0b8c32b4f4c8c729308f2315669/users/0bf215f89d1a41bb9aca92b106c2b015/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:15.831807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc64b34-73f9-438d-b860-ae81308e37b6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:15.889731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af1e25-10f4-4b93-8d41-7a92d054ebc9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:15.946977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:15.961201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f4ee4-e1f2-47ef-9fcc-0b5d73c4649d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:15.962030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4ee4-e1f2-47ef-9fcc-0b5d73c4649d service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:15.963418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4ee4-e1f2-47ef-9fcc-0b5d73c4649d service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:15.963418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4ee4-e1f2-47ef-9fcc-0b5d73c4649d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.047183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc64b34-73f9-438d-b860-ae81308e37b6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.059445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56cf97-396e-4dc1-b496-2f99dd5a7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.061048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56cf97-396e-4dc1-b496-2f99dd5a7597 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.062004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56cf97-396e-4dc1-b496-2f99dd5a7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.062392 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56cf97-396e-4dc1-b496-2f99dd5a7597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.063990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56cf97-396e-4dc1-b496-2f99dd5a7597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.066257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56cf97-396e-4dc1-b496-2f99dd5a7597 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.112340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f4ee4-e1f2-47ef-9fcc-0b5d73c4649d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.115801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f4ee4-e1f2-47ef-9fcc-0b5d73c4649d service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.122466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 940/1877] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:16.122466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56cf97-396e-4dc1-b496-2f99dd5a7597 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.140649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 938/1878] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:16.143892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eb61-d4b8-4460-87fc-f1d97e34fb85 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.144686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eb61-d4b8-4460-87fc-f1d97e34fb85 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.146775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eb61-d4b8-4460-87fc-f1d97e34fb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.149572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56cf97-396e-4dc1-b496-2f99dd5a7597 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.162207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.163154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.164165 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.169072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.169851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:16.170238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.172795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.203061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fa06eb61-d4b8-4460-87fc-f1d97e34fb85 None None] MFA Rules not processed for user `0bf215f89d1a41bb9aca92b106c2b015`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:16.205664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fa06eb61-d4b8-4460-87fc-f1d97e34fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.212441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 941/1879] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:16.214209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.222704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.251231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303a27-4e3b-47a8-98fa-35ecf9fd7f04 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.266929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.267375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.267666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.267943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] PATH_INFO: `/v3/users/2a5aec742ddb4f469dcc7b2195f35c84` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.275429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5aec742ddb4f469dcc7b2195f35c84)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.277974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.297961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 939/1880] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:16.297961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06eb61-d4b8-4460-87fc-f1d97e34fb85 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.324795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06eb61-d4b8-4460-87fc-f1d97e34fb85 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.340397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.341492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.341876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.342556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] PATH_INFO: `/v3/projects/93c2a7b5e896457baf8244add369429c/users/93f4884119ff4cca82690701523d7afa/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.359688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5aec742ddb4f469dcc7b2195f35c84'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:16.376195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5aec742ddb4f469dcc7b2195f35c84'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:16.383504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c2a7b5e896457baf8244add369429c, user_id=93f4884119ff4cca82690701523d7afa, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.386951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.387301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5aec742ddb4f469dcc7b2195f35c84'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:16.388797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5aec742ddb4f469dcc7b2195f35c84'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:16.391556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5aec742ddb4f469dcc7b2195f35c84'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:16.406610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 940/1881] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:16 2022] PUT /identity/v3/projects/93c2a7b5e896457baf8244add369429c/users/93f4884119ff4cca82690701523d7afa/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:16.407931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.411355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.426906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 942/1882] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:16 2022] DELETE /identity/v3/users/2a5aec742ddb4f469dcc7b2195f35c84 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:16.427948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.431418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.480661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:16.501121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:16.506822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a073-5c61-4f26-8183-efe130388ef1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.586739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.589735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.590126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.590440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d729c1-7c09-4be7-a511-c755606fe6b7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.590822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.592578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.596750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.601363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8ebe0-c827-492b-b147-c52e910b772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.604052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8ebe0-c827-492b-b147-c52e910b772c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.604463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8ebe0-c827-492b-b147-c52e910b772c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.604857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8ebe0-c827-492b-b147-c52e910b772c admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.605828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8ebe0-c827-492b-b147-c52e910b772c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.612899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8ebe0-c827-492b-b147-c52e910b772c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.661442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 941/1883] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:16.663535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.667907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.671816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 943/1884] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:16.673592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df5a0-cdd1-4c44-8641-b373b924359a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.674110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df5a0-cdd1-4c44-8641-b373b924359a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.674540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df5a0-cdd1-4c44-8641-b373b924359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.696283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-881df5a0-cdd1-4c44-8641-b373b924359a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:16.697912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-881df5a0-cdd1-4c44-8641-b373b924359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.796559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2c65-ee1b-421e-bbd5-9b12d932421e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.797588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 944/1885] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:16.799163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881df5a0-cdd1-4c44-8641-b373b924359a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.815688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcc62-1602-4385-91a0-b3caded1e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.816896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcc62-1602-4385-91a0-b3caded1e787 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.816896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcc62-1602-4385-91a0-b3caded1e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.817082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcc62-1602-4385-91a0-b3caded1e787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.817836 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcc62-1602-4385-91a0-b3caded1e787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.818028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881df5a0-cdd1-4c44-8641-b373b924359a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.819994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcc62-1602-4385-91a0-b3caded1e787 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.834648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.835382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.835673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.835955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.837066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.838481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 942/1886] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:16.839245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcc62-1602-4385-91a0-b3caded1e787 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.841116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.865346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcc62-1602-4385-91a0-b3caded1e787 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.880017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.880879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.880997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.881463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.882983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.884601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:16.890741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 945/1887] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:16.898514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.902295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.922731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 943/1888] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:16 2022] POST /identity/v3/users => generated 297 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:16.923637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:16.930155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:16.948882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258e3c-7eb6-434c-bcc4-d1131fdf3892 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:16.955060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:16.955945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:16.956230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:16.956509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] PATH_INFO: `/v3/projects/5293855828ee441a84fc0d256c838b68` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:16.958196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5293855828ee441a84fc0d256c838b68)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:16.960201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.027039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042793e0-ddab-4bb1-ac97-309e8b8548f0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.052729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de89b6-a513-42af-bfbd-0a15c4d82734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.053444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de89b6-a513-42af-bfbd-0a15c4d82734 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.054466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de89b6-a513-42af-bfbd-0a15c4d82734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.054569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de89b6-a513-42af-bfbd-0a15c4d82734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.058821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5293855828ee441a84fc0d256c838b68', 'request_id': 'req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.067072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5293855828ee441a84fc0d256c838b68', 'request_id': 'req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.074372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de89b6-a513-42af-bfbd-0a15c4d82734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.074549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5293855828ee441a84fc0d256c838b68', 'request_id': 'req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.075904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de89b6-a513-42af-bfbd-0a15c4d82734 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.080097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:17.100532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 946/1889] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:17.102087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de89b6-a513-42af-bfbd-0a15c4d82734 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.104610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] The token cache is being invalidate because project 5293855828ee441a84fc0d256c838b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:17.105932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.107821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.113037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 944/1890] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:16 2022] DELETE /identity/v3/projects/5293855828ee441a84fc0d256c838b68 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:17.113541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de89b6-a513-42af-bfbd-0a15c4d82734 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.114271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.121438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.156590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:17.198089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.198604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.198888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.199166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] PATH_INFO: `/v3/projects/93c2a7b5e896457baf8244add369429c/users/93f4884119ff4cca82690701523d7afa/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.201700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c2a7b5e896457baf8244add369429c, user_id=93f4884119ff4cca82690701523d7afa, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.204533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.215817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff072-6b4a-4b7c-8fd0-7730fd49fb37 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.224794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 947/1891] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:17 2022] PUT /identity/v3/projects/93c2a7b5e896457baf8244add369429c/users/93f4884119ff4cca82690701523d7afa/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:17.226265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.236628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.329563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.330692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.331105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.331482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.332415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.336138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.349962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 945/1892] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:17.352015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.355150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.362812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b5097-d156-41cf-874c-b62169332de2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.368519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed2c0a-5a2c-4aab-8294-8d66b1580dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.369632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2c0a-5a2c-4aab-8294-8d66b1580dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.369937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2c0a-5a2c-4aab-8294-8d66b1580dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.370200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed2c0a-5a2c-4aab-8294-8d66b1580dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.371111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed2c0a-5a2c-4aab-8294-8d66b1580dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.373520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed2c0a-5a2c-4aab-8294-8d66b1580dc9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.377738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539d852-422d-4557-9e64-6e6875ea701d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.383759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.385463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.385914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.386387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] PATH_INFO: `/v3/users/e55fff82b26540c19a5ef261cb5745e2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.389393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 948/1893] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:17.389727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55fff82b26540c19a5ef261cb5745e2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.392804 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.393402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de57d3-3839-44e7-9660-b3b3d6760116 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.394325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de57d3-3839-44e7-9660-b3b3d6760116 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.394637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de57d3-3839-44e7-9660-b3b3d6760116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.438567 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-20de57d3-3839-44e7-9660-b3b3d6760116 None None] MFA Rules not processed for user `93f4884119ff4cca82690701523d7afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:17.440315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-20de57d3-3839-44e7-9660-b3b3d6760116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.475296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55fff82b26540c19a5ef261cb5745e2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.515753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55fff82b26540c19a5ef261cb5745e2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.517138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55fff82b26540c19a5ef261cb5745e2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.529015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55fff82b26540c19a5ef261cb5745e2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.530329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55fff82b26540c19a5ef261cb5745e2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.548483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 946/1894] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:17 2022] DELETE /identity/v3/users/e55fff82b26540c19a5ef261cb5745e2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:17.550611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.553151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.558013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 949/1895] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:17.558750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de57d3-3839-44e7-9660-b3b3d6760116 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.560068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-20de57d3-3839-44e7-9660-b3b3d6760116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.568430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:17.581066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de57d3-3839-44e7-9660-b3b3d6760116 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.642381 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:17.650807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bbb85-07fb-4d2f-a999-9854bae152cf admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.658058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.658834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.659193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.659549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.660360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.662383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.666495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.667952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.668418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.668902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] PATH_INFO: `/v3/projects/af79ee7cee464c8da3d31fc9314c6498/users/ea6b75f2f4b443749bba3fb5556428e3/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.682284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 947/1896] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:17.683435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.686062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.690467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af79ee7cee464c8da3d31fc9314c6498, user_id=ea6b75f2f4b443749bba3fb5556428e3, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.694004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.702127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f99722-3e57-4176-aa63-f6936a66d314 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.708589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.709583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.709874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.710687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] PATH_INFO: `/v3/projects/052f4f16c6e34421989076db83f8c5cd` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.712024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] RBAC: Authorizing `identity:delete_project(project_id=052f4f16c6e34421989076db83f8c5cd)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.714208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.716798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 950/1897] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:17 2022] PUT /identity/v3/projects/af79ee7cee464c8da3d31fc9314c6498/users/ea6b75f2f4b443749bba3fb5556428e3/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:17.718437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.720845 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.810500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec0f15-7630-43d8-ac7d-c9561ec2ccf3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.821714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052f4f16c6e34421989076db83f8c5cd', 'request_id': 'req-88e07beb-3b05-4f04-a13d-47755f57496f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.833281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052f4f16c6e34421989076db83f8c5cd', 'request_id': 'req-88e07beb-3b05-4f04-a13d-47755f57496f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.846401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052f4f16c6e34421989076db83f8c5cd', 'request_id': 'req-88e07beb-3b05-4f04-a13d-47755f57496f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.885347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.886481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.886975 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] The token cache is being invalidate because project 052f4f16c6e34421989076db83f8c5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:17.887184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.887293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.887641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.887911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:17.889659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 948/1898] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:17 2022] DELETE /identity/v3/projects/052f4f16c6e34421989076db83f8c5cd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:17.890405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.893856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.893989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.966299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:17.968013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:17.969175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e07beb-3b05-4f04-a13d-47755f57496f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:17.974434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:17.975280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:17.976039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:17.976039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] PATH_INFO: `/v3/projects/e0d1f6bfd98a4b43a2fdc9f86effed99/users/b66005ae52704bcd84034301f60c1eee/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:17.978777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 951/1899] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:17.981124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:17.982710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:17.999695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04de4-84a9-429c-8a22-41246f58ada1 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.000732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d1f6bfd98a4b43a2fdc9f86effed99, user_id=b66005ae52704bcd84034301f60c1eee, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.003932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.009944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.011080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.011304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.011704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.013396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.015214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.038529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 949/1900] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:17 2022] PUT /identity/v3/projects/e0d1f6bfd98a4b43a2fdc9f86effed99/users/b66005ae52704bcd84034301f60c1eee/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:18.038529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.038529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.046762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 952/1901] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:18.047886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.051007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.061398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:18.065425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62d03-9e5e-402d-91b8-53da66759405 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.097246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:18.149927 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.150948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.151186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.151480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] PATH_INFO: `/v3/projects/cfe1fe0371f24819a1dae4b36839020b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.154474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe1fe0371f24819a1dae4b36839020b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.157339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.165739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5426c12-9a4d-4e1c-a795-aedcdce34fba admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.170836 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.171841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.172372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.172750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] PATH_INFO: `/v3/users/5c3741233f56490296662bcd4df285b7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.174309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3741233f56490296662bcd4df285b7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.176708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.240255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3741233f56490296662bcd4df285b7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.243768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe1fe0371f24819a1dae4b36839020b', 'request_id': 'req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.250930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe1fe0371f24819a1dae4b36839020b', 'request_id': 'req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.258136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3741233f56490296662bcd4df285b7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.258991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe1fe0371f24819a1dae4b36839020b', 'request_id': 'req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.259181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3741233f56490296662bcd4df285b7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.273658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3741233f56490296662bcd4df285b7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.274668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3741233f56490296662bcd4df285b7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.275090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] The token cache is being invalidate because project cfe1fe0371f24819a1dae4b36839020b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:18.276206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.277056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e5a696c5-d5d2-4afd-be8d-28dfec062f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:18.283170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 953/1902] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:18 2022] DELETE /identity/v3/projects/cfe1fe0371f24819a1dae4b36839020b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:18.283170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a68fe-fc9e-47e5-b57b-811ede2ebbcf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.283170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a68fe-fc9e-47e5-b57b-811ede2ebbcf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.283170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a68fe-fc9e-47e5-b57b-811ede2ebbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.307222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 950/1903] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:18 2022] DELETE /identity/v3/users/5c3741233f56490296662bcd4df285b7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:18.307943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.310002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.353891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-902a68fe-fc9e-47e5-b57b-811ede2ebbcf None None] MFA Rules not processed for user `b66005ae52704bcd84034301f60c1eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:18.355087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-902a68fe-fc9e-47e5-b57b-811ede2ebbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.427587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16ede7-1450-4aa6-8b34-140a9038d15b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.438654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04583399-63fa-407d-8de9-bb3a40934382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.440711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04583399-63fa-407d-8de9-bb3a40934382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.442134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04583399-63fa-407d-8de9-bb3a40934382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.442427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04583399-63fa-407d-8de9-bb3a40934382 admin admin] PATH_INFO: `/v3/projects/af79ee7cee464c8da3d31fc9314c6498/users/ea6b75f2f4b443749bba3fb5556428e3/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.447098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04583399-63fa-407d-8de9-bb3a40934382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af79ee7cee464c8da3d31fc9314c6498, user_id=ea6b75f2f4b443749bba3fb5556428e3, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.451238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04583399-63fa-407d-8de9-bb3a40934382 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.483033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 951/1904] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:18 2022] PUT /identity/v3/projects/af79ee7cee464c8da3d31fc9314c6498/users/ea6b75f2f4b443749bba3fb5556428e3/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:18.484403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1bb5-cd65-4007-b78e-2a6147f5796e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.484812 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1bb5-cd65-4007-b78e-2a6147f5796e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.485157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1bb5-cd65-4007-b78e-2a6147f5796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.523560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 954/1905] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:18.523560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c1b57-0887-4882-9bd4-4a5cfd420617 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.523560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c1b57-0887-4882-9bd4-4a5cfd420617 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.524285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c1b57-0887-4882-9bd4-4a5cfd420617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.537531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-725e1bb5-cd65-4007-b78e-2a6147f5796e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:18.539077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-725e1bb5-cd65-4007-b78e-2a6147f5796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.563224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-031c1b57-0887-4882-9bd4-4a5cfd420617 None None] MFA Rules not processed for user `ea6b75f2f4b443749bba3fb5556428e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:18.567288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-031c1b57-0887-4882-9bd4-4a5cfd420617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.571656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:18.637951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:18.668219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 952/1906] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:18.669895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1bb5-cd65-4007-b78e-2a6147f5796e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.671197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-725e1bb5-cd65-4007-b78e-2a6147f5796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.685319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1bb5-cd65-4007-b78e-2a6147f5796e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.694219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.694924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.695201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.695474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.696510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.704775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.720423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 955/1907] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:18.721730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3703ab-5804-46a4-82b8-a8009435434b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.722039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3703ab-5804-46a4-82b8-a8009435434b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.722775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3703ab-5804-46a4-82b8-a8009435434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.736862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 953/1908] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:18 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:18.737993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.739903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.783081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9a3703ab-5804-46a4-82b8-a8009435434b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:18.784412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9a3703ab-5804-46a4-82b8-a8009435434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.833597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8fa17-08cb-45d2-acc7-7babbb29a129 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.838638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.839385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.839793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.840076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.906377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 956/1909] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:18.910462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3703ab-5804-46a4-82b8-a8009435434b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.926062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3703ab-5804-46a4-82b8-a8009435434b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.936593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b02266-f459-4239-9570-9bde726e7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.937588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b02266-f459-4239-9570-9bde726e7372 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.937878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b02266-f459-4239-9570-9bde726e7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.938210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b02266-f459-4239-9570-9bde726e7372 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.938912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b02266-f459-4239-9570-9bde726e7372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.939516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.940997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.941098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b02266-f459-4239-9570-9bde726e7372 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.952563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 954/1910] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:18.953229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.954672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:18.968881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 957/1911] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:18 2022] POST /identity/v3/users => generated 300 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:18.970282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b02266-f459-4239-9570-9bde726e7372 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:18.973898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfbaed-5f7c-4aa7-9ee7-0ce5ee9395ce service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:18.979543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:18.980409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:18.980685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:18.981009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] PATH_INFO: `/v3/projects/ee5e055ecd4c496d9cd9948affee6aa3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:18.982197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5e055ecd4c496d9cd9948affee6aa3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:18.984105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:18.992240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b02266-f459-4239-9570-9bde726e7372 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.000019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.001222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.001491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.001777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.002570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:19.003408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.005592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.021558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 958/1912] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:19.023119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.026831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.045820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639c27d-3485-4060-9ef0-f0cff669e493 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.048924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:19.054643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5e055ecd4c496d9cd9948affee6aa3', 'request_id': 'req-7a875e99-5026-48ef-acc6-086d0f2d5d8c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.074227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5e055ecd4c496d9cd9948affee6aa3', 'request_id': 'req-7a875e99-5026-48ef-acc6-086d0f2d5d8c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.081317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5e055ecd4c496d9cd9948affee6aa3', 'request_id': 'req-7a875e99-5026-48ef-acc6-086d0f2d5d8c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.098977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] The token cache is being invalidate because project ee5e055ecd4c496d9cd9948affee6aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:19.099383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.100466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.106543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 955/1913] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:18 2022] DELETE /identity/v3/projects/ee5e055ecd4c496d9cd9948affee6aa3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:19.106543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.106727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.124032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.124959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.125247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.125526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] PATH_INFO: `/v3/users/5938716e983f4163a149636d7ea2ec3f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.129884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5938716e983f4163a149636d7ea2ec3f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.131781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.189574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:19.201293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5938716e983f4163a149636d7ea2ec3f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.210941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875e99-5026-48ef-acc6-086d0f2d5d8c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.217529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.219693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.219970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.221620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.222008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.224068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.226437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5938716e983f4163a149636d7ea2ec3f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.237178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 956/1914] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:19.237834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.239560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.243069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5938716e983f4163a149636d7ea2ec3f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.244078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5938716e983f4163a149636d7ea2ec3f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.245669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7a59e997-18c3-4c94-a2d7-626c3cc8c997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5938716e983f4163a149636d7ea2ec3f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:19.254601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3facad-207c-42ac-b414-3a888626e6ca admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.261392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391e872-b0e2-4a53-802a-5e208a31d893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.262555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391e872-b0e2-4a53-802a-5e208a31d893 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.262963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391e872-b0e2-4a53-802a-5e208a31d893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.263307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391e872-b0e2-4a53-802a-5e208a31d893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.264054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391e872-b0e2-4a53-802a-5e208a31d893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.266570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391e872-b0e2-4a53-802a-5e208a31d893 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.270449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 959/1915] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:19 2022] DELETE /identity/v3/users/5938716e983f4163a149636d7ea2ec3f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:19.272139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006cf2a-314f-4dd2-a6ca-fade09ba7414 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.273205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006cf2a-314f-4dd2-a6ca-fade09ba7414 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.274277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006cf2a-314f-4dd2-a6ca-fade09ba7414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.296405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7006cf2a-314f-4dd2-a6ca-fade09ba7414 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:19.298008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7006cf2a-314f-4dd2-a6ca-fade09ba7414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.331093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 957/1916] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:19.334685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c79a7-acc3-44bd-b3e8-453b30e53edf None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.335613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c79a7-acc3-44bd-b3e8-453b30e53edf None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.335870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c79a7-acc3-44bd-b3e8-453b30e53edf None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.337282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 958/1917] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:37:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:19.339140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c79a7-acc3-44bd-b3e8-453b30e53edf None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.345208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a40c79a7-acc3-44bd-b3e8-453b30e53edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.382398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 960/1918] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:19.384215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d58b-4f9b-4bdd-8147-77dadf767d8e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.384972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d58b-4f9b-4bdd-8147-77dadf767d8e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.385469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d58b-4f9b-4bdd-8147-77dadf767d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.417197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2fd1d58b-4f9b-4bdd-8147-77dadf767d8e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:19.418515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2fd1d58b-4f9b-4bdd-8147-77dadf767d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.487668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c79a7-acc3-44bd-b3e8-453b30e53edf None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.493512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893e138-c796-456c-8f4c-82c1a3211b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.494891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893e138-c796-456c-8f4c-82c1a3211b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.495343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893e138-c796-456c-8f4c-82c1a3211b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.495850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893e138-c796-456c-8f4c-82c1a3211b46 admin admin] PATH_INFO: `/v3/projects/59a0aaed3b25465c8f1ae48a4e544a92/users/580f3485b3d64bfea688b79c2e7f330c/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.518530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893e138-c796-456c-8f4c-82c1a3211b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a0aaed3b25465c8f1ae48a4e544a92, user_id=580f3485b3d64bfea688b79c2e7f330c, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.522316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893e138-c796-456c-8f4c-82c1a3211b46 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.538928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 961/1919] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:19.538928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1d58b-4f9b-4bdd-8147-77dadf767d8e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.540146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2fd1d58b-4f9b-4bdd-8147-77dadf767d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.549553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 959/1920] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:19 2022] PUT /identity/v3/projects/59a0aaed3b25465c8f1ae48a4e544a92/users/580f3485b3d64bfea688b79c2e7f330c/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:19.552018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647866f-ca28-41b5-8697-15b930b210a3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.552381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647866f-ca28-41b5-8697-15b930b210a3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.552729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647866f-ca28-41b5-8697-15b930b210a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.562423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1d58b-4f9b-4bdd-8147-77dadf767d8e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.577537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9647866f-ca28-41b5-8697-15b930b210a3 None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:19.579396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9647866f-ca28-41b5-8697-15b930b210a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.617951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:19.659663 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:19.669603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.670864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.671368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.672571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.673741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.676010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.677103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 960/1921] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:19.679601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b150-71f9-486c-be16-bb883a44eb07 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.679940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b150-71f9-486c-be16-bb883a44eb07 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.680221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b150-71f9-486c-be16-bb883a44eb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.708128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8064b150-71f9-486c-be16-bb883a44eb07 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:19.708760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 962/1922] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:19.709566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8064b150-71f9-486c-be16-bb883a44eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.709670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.711391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.718374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 961/1923] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:19.719235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b150-71f9-486c-be16-bb883a44eb07 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.720528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8064b150-71f9-486c-be16-bb883a44eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.778528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cdc61-2f4f-4772-a296-4fc427efac1a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.778738 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b150-71f9-486c-be16-bb883a44eb07 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.782340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.782992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.783279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.783442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea6b75f2f4b443749bba3fb5556428e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af79ee7cee464c8da3d31fc9314c6498', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.783570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.784236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.784524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.784807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.785561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:19.785867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.787460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.792581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.794033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.798849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 963/1924] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:19.799637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.806541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 962/1925] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:19.807368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.808702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:19.811194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b010d9-adf1-438b-8b2c-88d2111637c8 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.817138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bc9d8-3bf4-4aa3-911a-c20088ab6382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.817816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc9d8-3bf4-4aa3-911a-c20088ab6382 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.818093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc9d8-3bf4-4aa3-911a-c20088ab6382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.818379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc9d8-3bf4-4aa3-911a-c20088ab6382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.820001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bc9d8-3bf4-4aa3-911a-c20088ab6382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.822220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bc9d8-3bf4-4aa3-911a-c20088ab6382 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.825584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee8986-9608-4c4b-9a06-a6245a5334f1 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.835292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21d4b3-83cc-4de1-be6f-c7a406be53a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.835952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21d4b3-83cc-4de1-be6f-c7a406be53a5 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.836230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21d4b3-83cc-4de1-be6f-c7a406be53a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.836506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21d4b3-83cc-4de1-be6f-c7a406be53a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.841140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 964/1926] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:19.843396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bc9d8-3bf4-4aa3-911a-c20088ab6382 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.854711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21d4b3-83cc-4de1-be6f-c7a406be53a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.857813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21d4b3-83cc-4de1-be6f-c7a406be53a5 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.865199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bc9d8-3bf4-4aa3-911a-c20088ab6382 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.874582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb298910-6ecc-4171-8ca8-c241c5a85330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.875594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb298910-6ecc-4171-8ca8-c241c5a85330 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.876034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb298910-6ecc-4171-8ca8-c241c5a85330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.876329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb298910-6ecc-4171-8ca8-c241c5a85330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.877076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 963/1927] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:19.877639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb298910-6ecc-4171-8ca8-c241c5a85330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.877973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21d4b3-83cc-4de1-be6f-c7a406be53a5 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.880203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb298910-6ecc-4171-8ca8-c241c5a85330 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.897981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 965/1928] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:19.901821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb298910-6ecc-4171-8ca8-c241c5a85330 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.906216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21d4b3-83cc-4de1-be6f-c7a406be53a5 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.916919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.917659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.917972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.919386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.920306 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:19.920559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.924177 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.926310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb298910-6ecc-4171-8ca8-c241c5a85330 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.937854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 964/1929] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:19.938799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.941969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4e04-72a0-4c45-ab2f-6a55b29a6048 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea6b75f2f4b443749bba3fb5556428e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af79ee7cee464c8da3d31fc9314c6498', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.943170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4e04-72a0-4c45-ab2f-6a55b29a6048 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.944996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4e04-72a0-4c45-ab2f-6a55b29a6048 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.946074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4e04-72a0-4c45-ab2f-6a55b29a6048 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.947673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a4e04-72a0-4c45-ab2f-6a55b29a6048 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.951944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116582c-1c70-4757-8af7-9a193efdd71c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:19.956284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a4e04-72a0-4c45-ab2f-6a55b29a6048 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.965516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cb6eb-eb8d-45cf-ae6d-34c96b84c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:19.966535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cb6eb-eb8d-45cf-ae6d-34c96b84c908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:19.966825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cb6eb-eb8d-45cf-ae6d-34c96b84c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:19.967380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cb6eb-eb8d-45cf-ae6d-34c96b84c908 admin admin] PATH_INFO: `/v3/projects/59a0aaed3b25465c8f1ae48a4e544a92/users/580f3485b3d64bfea688b79c2e7f330c/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:19.971955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cb6eb-eb8d-45cf-ae6d-34c96b84c908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a0aaed3b25465c8f1ae48a4e544a92, user_id=580f3485b3d64bfea688b79c2e7f330c, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:19.975159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cb6eb-eb8d-45cf-ae6d-34c96b84c908 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:19.993513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 966/1930] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:19.994313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4e04-72a0-4c45-ab2f-6a55b29a6048 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:19.994730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 965/1931] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:19 2022] PUT /identity/v3/projects/59a0aaed3b25465c8f1ae48a4e544a92/users/580f3485b3d64bfea688b79c2e7f330c/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:19.996067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cb6eb-eb8d-45cf-ae6d-34c96b84c908 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.094816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cb6eb-eb8d-45cf-ae6d-34c96b84c908 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.123075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:20.123777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4e04-72a0-4c45-ab2f-6a55b29a6048 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.129086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71673c51-50a0-412f-ba64-030b103dd506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.129812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71673c51-50a0-412f-ba64-030b103dd506 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.130095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71673c51-50a0-412f-ba64-030b103dd506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.130387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71673c51-50a0-412f-ba64-030b103dd506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.131092 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71673c51-50a0-412f-ba64-030b103dd506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.132984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71673c51-50a0-412f-ba64-030b103dd506 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.143824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 967/1932] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:20.144737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71673c51-50a0-412f-ba64-030b103dd506 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.176252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552b309-c164-4226-9c61-efdb8b07a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.177123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b309-c164-4226-9c61-efdb8b07a11a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.177489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b309-c164-4226-9c61-efdb8b07a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.177867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b309-c164-4226-9c61-efdb8b07a11a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.179466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552b309-c164-4226-9c61-efdb8b07a11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.181750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552b309-c164-4226-9c61-efdb8b07a11a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.193327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:20.234038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71673c51-50a0-412f-ba64-030b103dd506 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.238746 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea6b75f2f4b443749bba3fb5556428e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af79ee7cee464c8da3d31fc9314c6498', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.239264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 966/1933] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:19 2022] POST /identity/v3/projects => generated 407 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:20.239494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.239854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.240150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.240359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b043-f240-43d2-ba46-70a19b73ceb8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.240643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b043-f240-43d2-ba46-70a19b73ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.240900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:20.240999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b043-f240-43d2-ba46-70a19b73ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.241881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.243615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.261364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 968/1934] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:20.261364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.273033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2055b043-f240-43d2-ba46-70a19b73ceb8 None None] MFA Rules not processed for user `580f3485b3d64bfea688b79c2e7f330c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:20.274320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2055b043-f240-43d2-ba46-70a19b73ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.284175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2b13-9b14-4b37-8f24-07bfc3b985f9 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.372743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 967/1935] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:20.388950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055b043-f240-43d2-ba46-70a19b73ceb8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.390608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2055b043-f240-43d2-ba46-70a19b73ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.390721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09889ab6-a93d-4413-87e8-5e9cab9a6f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.392710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09889ab6-a93d-4413-87e8-5e9cab9a6f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.393050 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09889ab6-a93d-4413-87e8-5e9cab9a6f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.393332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09889ab6-a93d-4413-87e8-5e9cab9a6f1b admin admin] PATH_INFO: `/v3/projects/7391586f474641ee9dad49425bc3f060/users/99a333406e944032b5d9e247559efbc5/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.407827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055b043-f240-43d2-ba46-70a19b73ceb8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.416105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.417030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09889ab6-a93d-4413-87e8-5e9cab9a6f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7391586f474641ee9dad49425bc3f060, user_id=99a333406e944032b5d9e247559efbc5, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.417195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.417519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.417837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] PATH_INFO: `/v3/projects/44f530d097d545beb5dca50f7a077657` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.419792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f530d097d545beb5dca50f7a077657)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.421224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09889ab6-a93d-4413-87e8-5e9cab9a6f1b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.421844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.441795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 969/1936] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:20 2022] PUT /identity/v3/projects/7391586f474641ee9dad49425bc3f060/users/99a333406e944032b5d9e247559efbc5/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:20.443139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09889ab6-a93d-4413-87e8-5e9cab9a6f1b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.497477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f530d097d545beb5dca50f7a077657', 'request_id': 'req-4086326a-f553-4c5e-ad18-254e2c1e5763'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.506294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f530d097d545beb5dca50f7a077657', 'request_id': 'req-4086326a-f553-4c5e-ad18-254e2c1e5763'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.514452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f530d097d545beb5dca50f7a077657', 'request_id': 'req-4086326a-f553-4c5e-ad18-254e2c1e5763'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.530787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] The token cache is being invalidate because project 44f530d097d545beb5dca50f7a077657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:20.531083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.531747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09889ab6-a93d-4413-87e8-5e9cab9a6f1b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.531870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.533877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 968/1937] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:20 2022] DELETE /identity/v3/projects/44f530d097d545beb5dca50f7a077657 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:20.534517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.535861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.559623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:20.596349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:20.604624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.605224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.605500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.605828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.606523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.608974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.613201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086326a-f553-4c5e-ad18-254e2c1e5763 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.619187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea6b75f2f4b443749bba3fb5556428e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af79ee7cee464c8da3d31fc9314c6498', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.620469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.621018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.621224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] PATH_INFO: `/v3/projects/4eb6b2d2e7254af6820eca750e4bd34b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.622595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4eb6b2d2e7254af6820eca750e4bd34b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.625078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.630897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 970/1938] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:20 2022] POST /identity/v3/users => generated 304 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:20.631768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.633444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.696088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb6b2d2e7254af6820eca750e4bd34b', 'request_id': 'req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.703301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f68de-d457-4fbe-bc23-7f784806e829 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:20.707185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb6b2d2e7254af6820eca750e4bd34b', 'request_id': 'req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.728269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb6b2d2e7254af6820eca750e4bd34b', 'request_id': 'req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.755011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] The token cache is being invalidate because project 4eb6b2d2e7254af6820eca750e4bd34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:20.755556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.756481 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-3a6debbc-cb2c-49bd-8e42-823bbb7257f5 tempest-VolumeQuotaClassesTest-1597165446 tempest-VolumeQuotaClassesTest-1597165446-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:20.759182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 969/1939] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:20 2022] DELETE /identity/v3/projects/4eb6b2d2e7254af6820eca750e4bd34b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:20.760715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2a848-df09-46fb-8c90-6a8e520e1b2c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.761187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2a848-df09-46fb-8c90-6a8e520e1b2c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.761470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2a848-df09-46fb-8c90-6a8e520e1b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.797957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e1f2a848-df09-46fb-8c90-6a8e520e1b2c None None] MFA Rules not processed for user `99a333406e944032b5d9e247559efbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:20.799350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e1f2a848-df09-46fb-8c90-6a8e520e1b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.812850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:20.813706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:20.814358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:20.814773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:20.820324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.897296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 970/1940] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:20.897296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2a848-df09-46fb-8c90-6a8e520e1b2c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.897296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e1f2a848-df09-46fb-8c90-6a8e520e1b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:20.947255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:20.950647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:20.969601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:20.970984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 971/1941] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:20.971976 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:20.989276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.013741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2a848-df09-46fb-8c90-6a8e520e1b2c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.015003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cfb76-304d-498b-8b10-575e7da4e644 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.025560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.027094 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.027728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.028019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] PATH_INFO: `/v3/users/93f4884119ff4cca82690701523d7afa` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.029066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.029747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.030482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.030761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.031784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f4884119ff4cca82690701523d7afa)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.034462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.036047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.050428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.080700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 972/1942] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:21.081920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.087891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.117338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb304ac-ac6e-4105-8ce3-f92a3d4a16c8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.126194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.126367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f4884119ff4cca82690701523d7afa'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.127985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.128947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.129411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.130570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.135011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.146301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f4884119ff4cca82690701523d7afa'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.147237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f4884119ff4cca82690701523d7afa'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.160947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f4884119ff4cca82690701523d7afa'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.161618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f4884119ff4cca82690701523d7afa'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.177993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 973/1943] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:21.179584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 971/1944] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:20 2022] DELETE /identity/v3/users/93f4884119ff4cca82690701523d7afa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:21.180318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.181859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.187830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.189555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.211730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:21.253404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dd535-a5c6-4870-ae54-c43a7d722bfb admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.259195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.260382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.260676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.261055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.261790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.263394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.266609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e566f-d9cc-419e-9ba5-655361e92c64 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.271892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.272807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.273136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.273412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] PATH_INFO: `/v3/users/b66005ae52704bcd84034301f60c1eee` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.274631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66005ae52704bcd84034301f60c1eee)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.276864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.299567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 972/1945] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:21.300714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.305016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.321265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe375-7952-40c7-b7a9-efea14def6c5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.327267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.328152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.328697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.329030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] PATH_INFO: `/v3/users/0bf215f89d1a41bb9aca92b106c2b015` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.330340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf215f89d1a41bb9aca92b106c2b015)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.332276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.334328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66005ae52704bcd84034301f60c1eee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.348768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66005ae52704bcd84034301f60c1eee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.358456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66005ae52704bcd84034301f60c1eee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.359181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66005ae52704bcd84034301f60c1eee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.359966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66005ae52704bcd84034301f60c1eee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.377993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 974/1946] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:21 2022] DELETE /identity/v3/users/b66005ae52704bcd84034301f60c1eee => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:21.378970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.384181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.392814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf215f89d1a41bb9aca92b106c2b015'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.395185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:21.415066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf215f89d1a41bb9aca92b106c2b015'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.415954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf215f89d1a41bb9aca92b106c2b015'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.427605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf215f89d1a41bb9aca92b106c2b015'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.429364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf215f89d1a41bb9aca92b106c2b015'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.446812 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 973/1947] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:21 2022] DELETE /identity/v3/users/0bf215f89d1a41bb9aca92b106c2b015 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:21.447713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.449334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.458574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc9a0-13c4-4941-b4cb-acf41feb5b54 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.507386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:21.520529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b93537-4710-4a65-a30c-43c0aa2e3ec7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.525702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6045f-404f-4850-b279-85fd493fcb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.526740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6045f-404f-4850-b279-85fd493fcb86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.527053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6045f-404f-4850-b279-85fd493fcb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.527384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6045f-404f-4850-b279-85fd493fcb86 admin admin] PATH_INFO: `/v3/projects/2150f2220f224f3fa4a6813631096b10/users/2191ab27f66e4bdda37d70cdfa541b2a/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.532300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3aa2d-3153-4a27-a67c-c0374c1fc815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.533028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3aa2d-3153-4a27-a67c-c0374c1fc815 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.533323 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3aa2d-3153-4a27-a67c-c0374c1fc815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.533602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3aa2d-3153-4a27-a67c-c0374c1fc815 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.534330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3aa2d-3153-4a27-a67c-c0374c1fc815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.536747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3aa2d-3153-4a27-a67c-c0374c1fc815 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.545667 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6045f-404f-4850-b279-85fd493fcb86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2150f2220f224f3fa4a6813631096b10, user_id=2191ab27f66e4bdda37d70cdfa541b2a, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.549521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6045f-404f-4850-b279-85fd493fcb86 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.564344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 975/1948] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/users => generated 301 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:21.565862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2b79-21b0-43eb-98a3-8a4bf222cf44 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.566153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2b79-21b0-43eb-98a3-8a4bf222cf44 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.566435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2b79-21b0-43eb-98a3-8a4bf222cf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.572914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 974/1949] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:21 2022] PUT /identity/v3/projects/2150f2220f224f3fa4a6813631096b10/users/2191ab27f66e4bdda37d70cdfa541b2a/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:21.572914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad0f2d-62de-4680-910e-778f52d8c7af None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.572914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad0f2d-62de-4680-910e-778f52d8c7af None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.572914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad0f2d-62de-4680-910e-778f52d8c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.589651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cf0e2b79-21b0-43eb-98a3-8a4bf222cf44 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:21.590806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-29ad0f2d-62de-4680-910e-778f52d8c7af None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:21.590922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cf0e2b79-21b0-43eb-98a3-8a4bf222cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.592269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-29ad0f2d-62de-4680-910e-778f52d8c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.653681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 976/1950] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:21.654178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 975/1951] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:21.654368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2b79-21b0-43eb-98a3-8a4bf222cf44 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.654550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad0f2d-62de-4680-910e-778f52d8c7af None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.654638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cf0e2b79-21b0-43eb-98a3-8a4bf222cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.654720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-29ad0f2d-62de-4680-910e-778f52d8c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.665951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad0f2d-62de-4680-910e-778f52d8c7af None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.669428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2b79-21b0-43eb-98a3-8a4bf222cf44 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.670584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb31ba-e181-46d4-b4b5-0cb4f0aad9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.671242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb31ba-e181-46d4-b4b5-0cb4f0aad9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.671523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb31ba-e181-46d4-b4b5-0cb4f0aad9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.671801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb31ba-e181-46d4-b4b5-0cb4f0aad9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.672525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb31ba-e181-46d4-b4b5-0cb4f0aad9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.674154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb31ba-e181-46d4-b4b5-0cb4f0aad9c9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.674446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.675296 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.675597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.675882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] PATH_INFO: `/v3/projects/93c2a7b5e896457baf8244add369429c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.677128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c2a7b5e896457baf8244add369429c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.679254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.684821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 976/1952] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:21.686172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb094a07-6b5d-46df-80d3-bc6f33b0202b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.686463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb094a07-6b5d-46df-80d3-bc6f33b0202b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.686745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb094a07-6b5d-46df-80d3-bc6f33b0202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.714565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fb094a07-6b5d-46df-80d3-bc6f33b0202b None None] MFA Rules not processed for user `2191ab27f66e4bdda37d70cdfa541b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:21.715764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fb094a07-6b5d-46df-80d3-bc6f33b0202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.728384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c2a7b5e896457baf8244add369429c', 'request_id': 'req-344a2187-01f0-4af0-bd69-bde2bf4f4067'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.734003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c2a7b5e896457baf8244add369429c', 'request_id': 'req-344a2187-01f0-4af0-bd69-bde2bf4f4067'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.740144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c2a7b5e896457baf8244add369429c', 'request_id': 'req-344a2187-01f0-4af0-bd69-bde2bf4f4067'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.744478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:21.753373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] The token cache is being invalidate because project 93c2a7b5e896457baf8244add369429c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:21.753660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.754309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:21.755968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 977/1953] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:21 2022] DELETE /identity/v3/projects/93c2a7b5e896457baf8244add369429c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:21.757364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.758684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.782565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 977/1954] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:21.783397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb094a07-6b5d-46df-80d3-bc6f33b0202b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.786797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fb094a07-6b5d-46df-80d3-bc6f33b0202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.815573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a2187-01f0-4af0-bd69-bde2bf4f4067 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.820099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.820777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.821085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.821502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.825880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.839997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:21.845355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb094a07-6b5d-46df-80d3-bc6f33b0202b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.849553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa975a2-e025-4be2-8583-ec1689829128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.850209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa975a2-e025-4be2-8583-ec1689829128 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.850673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa975a2-e025-4be2-8583-ec1689829128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.850782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa975a2-e025-4be2-8583-ec1689829128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.852673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3aa975a2-e025-4be2-8583-ec1689829128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.895481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.896973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.907126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 978/1955] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:21.907852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.909175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.918892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa975a2-e025-4be2-8583-ec1689829128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.920386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa975a2-e025-4be2-8583-ec1689829128 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.920663 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609870b1-72ce-4a0e-9311-7839a3015ed2 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:21.926507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d988eee-d70c-434a-929f-2ee8d8a2ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:21.927399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988eee-d70c-434a-929f-2ee8d8a2ebe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.927684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988eee-d70c-434a-929f-2ee8d8a2ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.927976 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988eee-d70c-434a-929f-2ee8d8a2ebe0 admin admin] PATH_INFO: `/v3/projects/e85c8c21b19e449eaa23f9f15edbd598/users/e90a8e4b194a44b1b8effc56208588f7/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.931151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 978/1956] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:21.932367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77797a-e741-48d0-9c8b-9ab3501f5066 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.932657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77797a-e741-48d0-9c8b-9ab3501f5066 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.934418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77797a-e741-48d0-9c8b-9ab3501f5066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:21.953128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2d77797a-e741-48d0-9c8b-9ab3501f5066 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:21.954356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2d77797a-e741-48d0-9c8b-9ab3501f5066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.956313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d988eee-d70c-434a-929f-2ee8d8a2ebe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85c8c21b19e449eaa23f9f15edbd598, user_id=e90a8e4b194a44b1b8effc56208588f7, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:21.960733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d988eee-d70c-434a-929f-2ee8d8a2ebe0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:21.965511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 979/1957] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:21.966465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77797a-e741-48d0-9c8b-9ab3501f5066 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:21.979597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2d77797a-e741-48d0-9c8b-9ab3501f5066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:21.993707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 979/1958] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:21 2022] PUT /identity/v3/projects/e85c8c21b19e449eaa23f9f15edbd598/users/e90a8e4b194a44b1b8effc56208588f7/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:21.995332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e742ee-39b1-4356-9686-ee493fd9c43e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:21.995834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e742ee-39b1-4356-9686-ee493fd9c43e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:21.996467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e742ee-39b1-4356-9686-ee493fd9c43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.000670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77797a-e741-48d0-9c8b-9ab3501f5066 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.027299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-04e742ee-39b1-4356-9686-ee493fd9c43e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:22.028544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-04e742ee-39b1-4356-9686-ee493fd9c43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:22.090791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ba3db-8597-4538-a19e-23b8b13cb303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.093350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ba3db-8597-4538-a19e-23b8b13cb303 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.094621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ba3db-8597-4538-a19e-23b8b13cb303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.095276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ba3db-8597-4538-a19e-23b8b13cb303 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.097698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ba3db-8597-4538-a19e-23b8b13cb303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.101691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ba3db-8597-4538-a19e-23b8b13cb303 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.132878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 980/1959] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:22.133480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e742ee-39b1-4356-9686-ee493fd9c43e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.134554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:22.147359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e742ee-39b1-4356-9686-ee493fd9c43e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.148294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 980/1960] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:21 2022] POST /identity/v3/projects => generated 409 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:22.149581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ba3db-8597-4538-a19e-23b8b13cb303 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.255257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c3aee-b03f-4e00-bfc4-e4652464428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.256040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3aee-b03f-4e00-bfc4-e4652464428e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.256387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3aee-b03f-4e00-bfc4-e4652464428e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.256786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3aee-b03f-4e00-bfc4-e4652464428e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.257711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c3aee-b03f-4e00-bfc4-e4652464428e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.259705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c3aee-b03f-4e00-bfc4-e4652464428e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.276685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ba3db-8597-4538-a19e-23b8b13cb303 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.285367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 981/1961] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:22.286502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c3aee-b03f-4e00-bfc4-e4652464428e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.292865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.294115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.296607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.297135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.298122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:22.298538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.300819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.311902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c3aee-b03f-4e00-bfc4-e4652464428e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.320077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 981/1962] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:22.320077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.329547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41371f2-4515-469a-8f5e-98ffbe949078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.330420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41371f2-4515-469a-8f5e-98ffbe949078 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.330717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41371f2-4515-469a-8f5e-98ffbe949078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.330996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41371f2-4515-469a-8f5e-98ffbe949078 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.331687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41371f2-4515-469a-8f5e-98ffbe949078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.337656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41371f2-4515-469a-8f5e-98ffbe949078 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.362871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43cdbb-d97c-47f7-ac6e-c2913a62fb69 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.386668 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb555-f8eb-44f9-a2cc-094ceb030714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.387731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb555-f8eb-44f9-a2cc-094ceb030714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.388731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb555-f8eb-44f9-a2cc-094ceb030714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.389120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb555-f8eb-44f9-a2cc-094ceb030714 admin admin] PATH_INFO: `/v3/projects/e85c8c21b19e449eaa23f9f15edbd598/users/e90a8e4b194a44b1b8effc56208588f7/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.392555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 982/1963] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:22 2022] POST /identity/v3/users => generated 311 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:22.393653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41371f2-4515-469a-8f5e-98ffbe949078 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.395454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cb555-f8eb-44f9-a2cc-094ceb030714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85c8c21b19e449eaa23f9f15edbd598, user_id=e90a8e4b194a44b1b8effc56208588f7, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.401864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cb555-f8eb-44f9-a2cc-094ceb030714 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.404385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:22.410857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41371f2-4515-469a-8f5e-98ffbe949078 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.420622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc324a-20d3-46df-981a-7f1444366f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.421688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc324a-20d3-46df-981a-7f1444366f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.422196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc324a-20d3-46df-981a-7f1444366f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.423481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc324a-20d3-46df-981a-7f1444366f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.427439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc324a-20d3-46df-981a-7f1444366f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.433499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 982/1964] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:22 2022] PUT /identity/v3/projects/e85c8c21b19e449eaa23f9f15edbd598/users/e90a8e4b194a44b1b8effc56208588f7/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:22.434817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc324a-20d3-46df-981a-7f1444366f62 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.435281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb555-f8eb-44f9-a2cc-094ceb030714 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.488785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 983/1965] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:22 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:22.490450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af92273-1f28-4378-9320-f2eb26854f39 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.490743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af92273-1f28-4378-9320-f2eb26854f39 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.491070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af92273-1f28-4378-9320-f2eb26854f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.528102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6af92273-1f28-4378-9320-f2eb26854f39 None None] MFA Rules not processed for user `e90a8e4b194a44b1b8effc56208588f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:22.529441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6af92273-1f28-4378-9320-f2eb26854f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:22.571504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb555-f8eb-44f9-a2cc-094ceb030714 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.679500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6bbbf-8bdb-4443-8b2c-f261d21ade31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.680280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6bbbf-8bdb-4443-8b2c-f261d21ade31 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.680679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6bbbf-8bdb-4443-8b2c-f261d21ade31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.681059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6bbbf-8bdb-4443-8b2c-f261d21ade31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.681915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6bbbf-8bdb-4443-8b2c-f261d21ade31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.683653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6bbbf-8bdb-4443-8b2c-f261d21ade31 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.695881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 984/1966] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:22.698207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af92273-1f28-4378-9320-f2eb26854f39 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.699889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6af92273-1f28-4378-9320-f2eb26854f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:22.707952 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 983/1967] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:22.714225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6bbbf-8bdb-4443-8b2c-f261d21ade31 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.721376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af92273-1f28-4378-9320-f2eb26854f39 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.726466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6bbbf-8bdb-4443-8b2c-f261d21ade31 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.728891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.729787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.730291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.730585 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] PATH_INFO: `/v3/projects/e0d1f6bfd98a4b43a2fdc9f86effed99` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.732041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.732534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d1f6bfd98a4b43a2fdc9f86effed99)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.733523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.734005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.734448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.734776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.735681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.738765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.768391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 984/1968] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:22 2022] POST /identity/v3/users => generated 292 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:22.769611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.771350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:22.784649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:22.790152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788078b-2901-4231-9ce9-29a9bf93003f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.806664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d1f6bfd98a4b43a2fdc9f86effed99', 'request_id': 'req-5dcf826f-76ae-4077-b846-a6c8ede39507'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.815760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d1f6bfd98a4b43a2fdc9f86effed99', 'request_id': 'req-5dcf826f-76ae-4077-b846-a6c8ede39507'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.825587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d1f6bfd98a4b43a2fdc9f86effed99', 'request_id': 'req-5dcf826f-76ae-4077-b846-a6c8ede39507'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.843582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] The token cache is being invalidate because project e0d1f6bfd98a4b43a2fdc9f86effed99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:22.844022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.844810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.847055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 985/1969] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:22 2022] DELETE /identity/v3/projects/e0d1f6bfd98a4b43a2fdc9f86effed99 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:22.848011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.849591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:22.877504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.879619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.880804 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.881923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] PATH_INFO: `/v3/projects/55bfc0b8c32b4f4c8c729308f2315669` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.883537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bfc0b8c32b4f4c8c729308f2315669)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:22.887257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:22.924158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf826f-76ae-4077-b846-a6c8ede39507 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:22.928134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:22.928968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:22.929159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:22.929431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:22.932313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:22.938434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:22.945194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bfc0b8c32b4f4c8c729308f2315669', 'request_id': 'req-5816e2fa-8b4b-46d5-85f8-e4e180079104'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.953087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bfc0b8c32b4f4c8c729308f2315669', 'request_id': 'req-5816e2fa-8b4b-46d5-85f8-e4e180079104'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.961597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bfc0b8c32b4f4c8c729308f2315669', 'request_id': 'req-5816e2fa-8b4b-46d5-85f8-e4e180079104'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.978474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] The token cache is being invalidate because project 55bfc0b8c32b4f4c8c729308f2315669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:22.978959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.980368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:22.982053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 985/1970] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:22 2022] DELETE /identity/v3/projects/55bfc0b8c32b4f4c8c729308f2315669 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:22.985725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:22.987963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.013486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.015384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.027522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 986/1971] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:23.028928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.030770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.044306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67c8c-7eb4-4187-b09f-281ac1fd0e80 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.075843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e2fa-8b4b-46d5-85f8-e4e180079104 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.081866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.082760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.083187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.083469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] PATH_INFO: `/v3/projects/9213ae86381747e49093834430d15167/users/600bb3c19853492fac247a9d9a868a0e/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.105980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9213ae86381747e49093834430d15167, user_id=600bb3c19853492fac247a9d9a868a0e, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.110433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.115285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.117221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.117221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.117221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.117561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.120054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.129456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 986/1972] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:22 2022] PUT /identity/v3/projects/9213ae86381747e49093834430d15167/users/600bb3c19853492fac247a9d9a868a0e/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:23.130703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.134503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.136649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 987/1973] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:23.137874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.139513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.153339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03436dcb-4983-4043-b7dc-42bdb0d54b48 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.172678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:23.221393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.221594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5a0f6-bc55-4ca1-ba8d-797bb22a395b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.222192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.222474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.222745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] PATH_INFO: `/v3/users/ea6b75f2f4b443749bba3fb5556428e3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.223897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6b75f2f4b443749bba3fb5556428e3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.225919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.226209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.227119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.227398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.227677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] PATH_INFO: `/v3/users/580f3485b3d64bfea688b79c2e7f330c` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.228937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580f3485b3d64bfea688b79c2e7f330c)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.231320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.273138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:23.282586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6b75f2f4b443749bba3fb5556428e3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.282731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580f3485b3d64bfea688b79c2e7f330c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.298591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6b75f2f4b443749bba3fb5556428e3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.302132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580f3485b3d64bfea688b79c2e7f330c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.303135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580f3485b3d64bfea688b79c2e7f330c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.309330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6b75f2f4b443749bba3fb5556428e3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.311460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6b75f2f4b443749bba3fb5556428e3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.312658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6b75f2f4b443749bba3fb5556428e3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.323214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580f3485b3d64bfea688b79c2e7f330c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.323989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580f3485b3d64bfea688b79c2e7f330c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.339814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 988/1974] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:23 2022] DELETE /identity/v3/users/ea6b75f2f4b443749bba3fb5556428e3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:23.345246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.348742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.353997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 987/1975] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:23 2022] DELETE /identity/v3/users/580f3485b3d64bfea688b79c2e7f330c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:23.356983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.357763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.423847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec6367-f5d9-428b-8fc6-f384650d5fed admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.455421 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddf2d5-98e7-4e46-bf0e-2a76a5f732c7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.462339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.463682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.465017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.465429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.466637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.468575 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.489388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 988/1976] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:23.490284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.495929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.503949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.504786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.505200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.506276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.508463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.510601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.511431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28505f7f-7e1e-4a39-a055-37c96a3dc34c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.517192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.518086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.518372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.518647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] PATH_INFO: `/v3/users/99a333406e944032b5d9e247559efbc5` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.520199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a333406e944032b5d9e247559efbc5)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.523126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.525582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 989/1977] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:23.527530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.531063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.549684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa2a3-70f7-47aa-8a2b-2f9810d02ffd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.555370 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728ee8-3fb5-4376-88be-2bc837cf3a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.556885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ee8-3fb5-4376-88be-2bc837cf3a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.557012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ee8-3fb5-4376-88be-2bc837cf3a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.557784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ee8-3fb5-4376-88be-2bc837cf3a01 admin admin] PATH_INFO: `/v3/projects/0809b5e191cb4a41896360df61d1ca3d/users/846d8aaa2b074b9da2eb8a23b820c32a/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.583429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:23.599051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728ee8-3fb5-4376-88be-2bc837cf3a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0809b5e191cb4a41896360df61d1ca3d, user_id=846d8aaa2b074b9da2eb8a23b820c32a, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.606797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728ee8-3fb5-4376-88be-2bc837cf3a01 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.614244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a333406e944032b5d9e247559efbc5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.633792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 990/1978] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:23 2022] PUT /identity/v3/projects/0809b5e191cb4a41896360df61d1ca3d/users/846d8aaa2b074b9da2eb8a23b820c32a/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:23.634540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728ee8-3fb5-4376-88be-2bc837cf3a01 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.647255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a333406e944032b5d9e247559efbc5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.647255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a333406e944032b5d9e247559efbc5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.661139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a333406e944032b5d9e247559efbc5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.661835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8895fb69-51fa-4eed-9da8-638157146cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a333406e944032b5d9e247559efbc5'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:23.692819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 989/1979] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:23 2022] DELETE /identity/v3/users/99a333406e944032b5d9e247559efbc5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:23.695283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e22ef-7a60-43ed-9fe9-277b0654d290 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.695682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e22ef-7a60-43ed-9fe9-277b0654d290 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.696010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e22ef-7a60-43ed-9fe9-277b0654d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.724903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:23.765152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-745e22ef-7a60-43ed-9fe9-277b0654d290 None None] MFA Rules not processed for user `846d8aaa2b074b9da2eb8a23b820c32a`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:23.771039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-745e22ef-7a60-43ed-9fe9-277b0654d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.781878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728ee8-3fb5-4376-88be-2bc837cf3a01 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:23.884945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:23.886081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.886622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.886906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] PATH_INFO: `/v3/projects/9213ae86381747e49093834430d15167/users/600bb3c19853492fac247a9d9a868a0e/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.894544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9213ae86381747e49093834430d15167, user_id=600bb3c19853492fac247a9d9a868a0e, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:23.900469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:23.915001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 990/1980] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:23.916969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092185-04d8-471d-af06-96d8cb965ddb None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:23.917445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092185-04d8-471d-af06-96d8cb965ddb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:23.917961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092185-04d8-471d-af06-96d8cb965ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:23.921250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 991/1981] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:23 2022] PUT /identity/v3/projects/9213ae86381747e49093834430d15167/users/600bb3c19853492fac247a9d9a868a0e/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:23.921250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:23.929684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:23.954605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-58092185-04d8-471d-af06-96d8cb965ddb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:23.957471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-58092185-04d8-471d-af06-96d8cb965ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.067741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 991/1982] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:24.069042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58092185-04d8-471d-af06-96d8cb965ddb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.077568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-58092185-04d8-471d-af06-96d8cb965ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.090437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef99e92-7eb8-453a-9593-4cd90fa9b32a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.096769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.098185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.098977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.099119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] PATH_INFO: `/v3/projects/af79ee7cee464c8da3d31fc9314c6498` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.101126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af79ee7cee464c8da3d31fc9314c6498)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.103395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.129792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:24.154919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58092185-04d8-471d-af06-96d8cb965ddb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.162630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af79ee7cee464c8da3d31fc9314c6498', 'request_id': 'req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.170336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af79ee7cee464c8da3d31fc9314c6498', 'request_id': 'req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.179959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af79ee7cee464c8da3d31fc9314c6498', 'request_id': 'req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.195807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] The token cache is being invalidate because project af79ee7cee464c8da3d31fc9314c6498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:24.196345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.197037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c32ae90-f4a8-42ff-bd9f-daad2bfbff7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.199932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 992/1983] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:23 2022] DELETE /identity/v3/projects/af79ee7cee464c8da3d31fc9314c6498 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:24.204243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581be91-6397-47ce-97aa-91044dbcd68d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.204551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581be91-6397-47ce-97aa-91044dbcd68d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.204846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581be91-6397-47ce-97aa-91044dbcd68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.217920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.218340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:24.218933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.218933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.219189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.222551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.236818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1581be91-6397-47ce-97aa-91044dbcd68d None None] MFA Rules not processed for user `600bb3c19853492fac247a9d9a868a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:24.238036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1581be91-6397-47ce-97aa-91044dbcd68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.285674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.287035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.296859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 992/1984] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:24.299174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.300542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.306964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 993/1985] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:24.307810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581be91-6397-47ce-97aa-91044dbcd68d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.309183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1581be91-6397-47ce-97aa-91044dbcd68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.369901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581be91-6397-47ce-97aa-91044dbcd68d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.374464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fafca-8169-4bfa-b21f-8d293be62f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.375250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fafca-8169-4bfa-b21f-8d293be62f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.375528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fafca-8169-4bfa-b21f-8d293be62f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.375802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fafca-8169-4bfa-b21f-8d293be62f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.377798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a48fafca-8169-4bfa-b21f-8d293be62f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.385754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507d2b3-078c-4da1-bf11-acbf7dad9bb4 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.391807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fafca-8169-4bfa-b21f-8d293be62f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.393024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.393372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fafca-8169-4bfa-b21f-8d293be62f3d service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.394028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.394590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.394925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] PATH_INFO: `/v3/projects/59a0aaed3b25465c8f1ae48a4e544a92` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.398467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a0aaed3b25465c8f1ae48a4e544a92)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.400581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.404578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 994/1986] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:24.405898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ea19-a852-40b7-ad37-5d1b4446a8cb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.406173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ea19-a852-40b7-ad37-5d1b4446a8cb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.406451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430ea19-a852-40b7-ad37-5d1b4446a8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.425322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7430ea19-a852-40b7-ad37-5d1b4446a8cb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:24.426526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7430ea19-a852-40b7-ad37-5d1b4446a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.436023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 995/1987] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:24.443072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430ea19-a852-40b7-ad37-5d1b4446a8cb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.446320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7430ea19-a852-40b7-ad37-5d1b4446a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.453579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:24.455614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a0aaed3b25465c8f1ae48a4e544a92', 'request_id': 'req-ccd73968-4e88-4945-a03a-77566d2ecbc3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.458747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430ea19-a852-40b7-ad37-5d1b4446a8cb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.468605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a0aaed3b25465c8f1ae48a4e544a92', 'request_id': 'req-ccd73968-4e88-4945-a03a-77566d2ecbc3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.483276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a0aaed3b25465c8f1ae48a4e544a92', 'request_id': 'req-ccd73968-4e88-4945-a03a-77566d2ecbc3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.496533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] The token cache is being invalidate because project 59a0aaed3b25465c8f1ae48a4e544a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:24.497261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.498043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.504117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 993/1988] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:24 2022] DELETE /identity/v3/projects/59a0aaed3b25465c8f1ae48a4e544a92 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:24.504117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.506246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.516495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e752db-c09b-4285-a64f-bf5ae68c8e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.517282 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e752db-c09b-4285-a64f-bf5ae68c8e84 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.517694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e752db-c09b-4285-a64f-bf5ae68c8e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.518094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e752db-c09b-4285-a64f-bf5ae68c8e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.519992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-60e752db-c09b-4285-a64f-bf5ae68c8e84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.574104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:24.599722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e752db-c09b-4285-a64f-bf5ae68c8e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.601376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e752db-c09b-4285-a64f-bf5ae68c8e84 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.606956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73968-4e88-4945-a03a-77566d2ecbc3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.611707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 996/1989] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:24.612810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6128-a310-4f99-88f3-01e734cec9ec None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.613350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.613479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6128-a310-4f99-88f3-01e734cec9ec None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.613645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6128-a310-4f99-88f3-01e734cec9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.614434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.614679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.616597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] PATH_INFO: `/v3/users/846d8aaa2b074b9da2eb8a23b820c32a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.618103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846d8aaa2b074b9da2eb8a23b820c32a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.620115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.660970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ab4a6128-a310-4f99-88f3-01e734cec9ec None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:24.666244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ab4a6128-a310-4f99-88f3-01e734cec9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.692557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 997/1990] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:24.693992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6e94-0488-4328-8c04-87a2b713365f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.694311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6e94-0488-4328-8c04-87a2b713365f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.694763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6e94-0488-4328-8c04-87a2b713365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.715442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eddb6e94-0488-4328-8c04-87a2b713365f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:24.716696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eddb6e94-0488-4328-8c04-87a2b713365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.717365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846d8aaa2b074b9da2eb8a23b820c32a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.735125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 998/1991] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:24.736067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846d8aaa2b074b9da2eb8a23b820c32a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.736305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb6e94-0488-4328-8c04-87a2b713365f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.737521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846d8aaa2b074b9da2eb8a23b820c32a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.747919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb6e94-0488-4328-8c04-87a2b713365f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.749210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846d8aaa2b074b9da2eb8a23b820c32a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.749909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846d8aaa2b074b9da2eb8a23b820c32a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:24.752974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef900c6c-d196-4732-9ba5-5b457841a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.753639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900c6c-d196-4732-9ba5-5b457841a3af admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.753921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900c6c-d196-4732-9ba5-5b457841a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.754196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900c6c-d196-4732-9ba5-5b457841a3af admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.755062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef900c6c-d196-4732-9ba5-5b457841a3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:24.755367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef900c6c-d196-4732-9ba5-5b457841a3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.757297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef900c6c-d196-4732-9ba5-5b457841a3af admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.776392 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 999/1992] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:24.778469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8c82-e3d2-4efb-bcb0-5747f1596795 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.778857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8c82-e3d2-4efb-bcb0-5747f1596795 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.779155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8c82-e3d2-4efb-bcb0-5747f1596795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.783533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 994/1993] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:24 2022] DELETE /identity/v3/users/846d8aaa2b074b9da2eb8a23b820c32a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:24.784407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.786365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.830720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-37eb8c82-e3d2-4efb-bcb0-5747f1596795 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:24.833168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-37eb8c82-e3d2-4efb-bcb0-5747f1596795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.874358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:24.879620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b2825-d062-4a0a-901e-7b055345e450 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:24.885484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:24.886255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.886619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.887075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.888203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:24.890543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:24.910632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1000/1994] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:24.912125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b272c-db6b-48e8-9fa0-1627094b3612 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:24.912419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b272c-db6b-48e8-9fa0-1627094b3612 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:24.912709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b272c-db6b-48e8-9fa0-1627094b3612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:24.924875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 995/1995] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:24 2022] POST /identity/v3/projects => generated 399 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:24.924875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:24.927895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.932390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ac4b272c-db6b-48e8-9fa0-1627094b3612 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:24.933651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ac4b272c-db6b-48e8-9fa0-1627094b3612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:24.999245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe22f-bf74-411e-8a87-5eaacdac67f1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.002203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1001/1996] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:25.003181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b272c-db6b-48e8-9fa0-1627094b3612 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.007244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.008320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.008818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.009258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] PATH_INFO: `/v3/projects/7391586f474641ee9dad49425bc3f060` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.010882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7391586f474641ee9dad49425bc3f060)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.013095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.013970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ac4b272c-db6b-48e8-9fa0-1627094b3612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.071799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7391586f474641ee9dad49425bc3f060', 'request_id': 'req-663f169f-16e3-45bf-9d0e-974aafaaad26'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.078844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b272c-db6b-48e8-9fa0-1627094b3612 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.085731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:25.086046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7391586f474641ee9dad49425bc3f060', 'request_id': 'req-663f169f-16e3-45bf-9d0e-974aafaaad26'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.096974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7391586f474641ee9dad49425bc3f060', 'request_id': 'req-663f169f-16e3-45bf-9d0e-974aafaaad26'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.111088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] The token cache is being invalidate because project 7391586f474641ee9dad49425bc3f060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:25.111379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.112367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.114366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 996/1997] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:24 2022] DELETE /identity/v3/projects/7391586f474641ee9dad49425bc3f060 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:25.117754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.119705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.140436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.150713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.151001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.151278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.153345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.202523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f169f-16e3-45bf-9d0e-974aafaaad26 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.208555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.209314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.210401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.210689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.211491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:25.211796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.213736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.228441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 997/1998] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:25.229264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.231895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.239560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.241631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.243794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:25.248245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec4e71-aaf5-4eea-adcd-5097ead6acea admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.255271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.256253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.257487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.258145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.259091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.262378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.274367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1002/1999] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:25.277848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.282541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.294163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 998/2000] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:25 2022] POST /identity/v3/users => generated 300 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:25.295050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.299830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.322263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924301-3c70-4c21-b3c8-53b68a9a8ddc admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.328425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.329544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.329904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.330411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] PATH_INFO: `/v3/users/e90a8e4b194a44b1b8effc56208588f7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.332156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90a8e4b194a44b1b8effc56208588f7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.334446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.378952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df697b-6556-44e8-97e7-a45c1ed9ebb8 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.383594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.384426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.384859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.385043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.387193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.398220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90a8e4b194a44b1b8effc56208588f7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.400175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.401668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.412336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90a8e4b194a44b1b8effc56208588f7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.413177 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90a8e4b194a44b1b8effc56208588f7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.413581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1003/2001] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:25.414632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.426223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90a8e4b194a44b1b8effc56208588f7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.426899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c0546-d6d4-48bd-9386-7e546932e695 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.427973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90a8e4b194a44b1b8effc56208588f7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:25.433558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.434447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.434942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.435232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.436137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.438680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.447355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 999/2002] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:25 2022] DELETE /identity/v3/users/e90a8e4b194a44b1b8effc56208588f7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:25.447355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.447355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.497009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1004/2003] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:25 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:25.498032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.500674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.572341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:25.573552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53007681-82ff-46b6-b6ca-0aa49a98b873 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.600729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb053c-aa28-40e1-8486-f531ee1a873e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.605636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61046ab9-f39b-43e1-bbf8-24a6e0774b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.606319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61046ab9-f39b-43e1-bbf8-24a6e0774b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.606606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61046ab9-f39b-43e1-bbf8-24a6e0774b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.606888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61046ab9-f39b-43e1-bbf8-24a6e0774b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.607938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61046ab9-f39b-43e1-bbf8-24a6e0774b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.626911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61046ab9-f39b-43e1-bbf8-24a6e0774b20 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.668783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65016909-f26f-4b8a-a793-793c3cda7daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.670075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65016909-f26f-4b8a-a793-793c3cda7daa admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.670539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65016909-f26f-4b8a-a793-793c3cda7daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.670985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65016909-f26f-4b8a-a793-793c3cda7daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.671865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65016909-f26f-4b8a-a793-793c3cda7daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.674207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65016909-f26f-4b8a-a793-793c3cda7daa admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.686877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1000/2004] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:25.693723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65016909-f26f-4b8a-a793-793c3cda7daa admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.709442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1005/2005] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:25 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:25.709882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:25.710917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61046ab9-f39b-43e1-bbf8-24a6e0774b20 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.733242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65016909-f26f-4b8a-a793-793c3cda7daa admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.747943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606bbe8-b917-4296-84e5-cac0100d9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.748647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606bbe8-b917-4296-84e5-cac0100d9518 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.748976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606bbe8-b917-4296-84e5-cac0100d9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.749290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606bbe8-b917-4296-84e5-cac0100d9518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.750005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606bbe8-b917-4296-84e5-cac0100d9518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.751630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606bbe8-b917-4296-84e5-cac0100d9518 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.758831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61046ab9-f39b-43e1-bbf8-24a6e0774b20 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.767848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614198cd-965b-4cf3-ba2f-31f65218c1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.768575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614198cd-965b-4cf3-ba2f-31f65218c1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.768899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614198cd-965b-4cf3-ba2f-31f65218c1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.769190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614198cd-965b-4cf3-ba2f-31f65218c1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.772097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614198cd-965b-4cf3-ba2f-31f65218c1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.775880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614198cd-965b-4cf3-ba2f-31f65218c1d9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.794682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1001/2006] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:25.797166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1006/2007] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:25.799543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606bbe8-b917-4296-84e5-cac0100d9518 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.801531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614198cd-965b-4cf3-ba2f-31f65218c1d9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.817226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614198cd-965b-4cf3-ba2f-31f65218c1d9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.826569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8f8f-d7fb-445f-b4f6-225f7fc63458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.827494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8f8f-d7fb-445f-b4f6-225f7fc63458 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.828133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8f8f-d7fb-445f-b4f6-225f7fc63458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.828582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8f8f-d7fb-445f-b4f6-225f7fc63458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.829860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd8f8f-d7fb-445f-b4f6-225f7fc63458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.835128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd8f8f-d7fb-445f-b4f6-225f7fc63458 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.845546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606bbe8-b917-4296-84e5-cac0100d9518 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.871148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1007/2008] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:25.874827 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.875350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8f8f-d7fb-445f-b4f6-225f7fc63458 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.875758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.876126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.876414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] PATH_INFO: `/v3/projects/bbbe638f36b94399875aaf0fca59e12a/users/d67ebbcdbcd14e0c880618d5a16db4d0/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.892874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8f8f-d7fb-445f-b4f6-225f7fc63458 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:25.899965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f83bea-9359-4dce-86e5-b9f86a9a8ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:25.901579 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83bea-9359-4dce-86e5-b9f86a9a8ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.901959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83bea-9359-4dce-86e5-b9f86a9a8ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.902383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83bea-9359-4dce-86e5-b9f86a9a8ca3 admin admin] PATH_INFO: `/v3/projects/522dd1c0bcbe494d8b167968aa5b5436/users/c4936b751ccb445ba11ad221194ae26b/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:25.925091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbe638f36b94399875aaf0fca59e12a, user_id=d67ebbcdbcd14e0c880618d5a16db4d0, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.933452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f83bea-9359-4dce-86e5-b9f86a9a8ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522dd1c0bcbe494d8b167968aa5b5436, user_id=c4936b751ccb445ba11ad221194ae26b, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:25.936805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.937486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f83bea-9359-4dce-86e5-b9f86a9a8ca3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:25.961146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1002/2009] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:25 2022] PUT /identity/v3/projects/bbbe638f36b94399875aaf0fca59e12a/users/d67ebbcdbcd14e0c880618d5a16db4d0/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:25.962949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:25.964782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:25.973489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1008/2010] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:25 2022] PUT /identity/v3/projects/522dd1c0bcbe494d8b167968aa5b5436/users/c4936b751ccb445ba11ad221194ae26b/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:25.977857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb7ab-0a33-4329-8065-e1f735f1bd1a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:25.978159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb7ab-0a33-4329-8065-e1f735f1bd1a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:25.978450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb7ab-0a33-4329-8065-e1f735f1bd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.014580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-706cb7ab-0a33-4329-8065-e1f735f1bd1a None None] MFA Rules not processed for user `d67ebbcdbcd14e0c880618d5a16db4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:26.016245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-706cb7ab-0a33-4329-8065-e1f735f1bd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.128643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cfc1d-0a9d-430c-b4ff-db4d9e53789b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.159616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1009/2011] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:26.161568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c52429-4079-481a-90a5-dd51cb427c4f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.161568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c52429-4079-481a-90a5-dd51cb427c4f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.161783 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c52429-4079-481a-90a5-dd51cb427c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.195556 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-97c52429-4079-481a-90a5-dd51cb427c4f None None] MFA Rules not processed for user `c4936b751ccb445ba11ad221194ae26b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:26.196952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-97c52429-4079-481a-90a5-dd51cb427c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.218052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.218934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.219220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.219501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] PATH_INFO: `/v3/projects/0809b5e191cb4a41896360df61d1ca3d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.220762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0809b5e191cb4a41896360df61d1ca3d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.222709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.273911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1010/2012] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:26.274908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c52429-4079-481a-90a5-dd51cb427c4f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.276208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-97c52429-4079-481a-90a5-dd51cb427c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.284347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0809b5e191cb4a41896360df61d1ca3d', 'request_id': 'req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.291276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0809b5e191cb4a41896360df61d1ca3d', 'request_id': 'req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.291429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c52429-4079-481a-90a5-dd51cb427c4f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.298307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0809b5e191cb4a41896360df61d1ca3d', 'request_id': 'req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.311376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:26.318273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] The token cache is being invalidate because project 0809b5e191cb4a41896360df61d1ca3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:26.318648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.319908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.325185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1003/2013] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:25 2022] DELETE /identity/v3/projects/0809b5e191cb4a41896360df61d1ca3d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:26.329122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.330540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.337752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:26.372817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.373736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.374026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.374314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] PATH_INFO: `/v3/projects/e85c8c21b19e449eaa23f9f15edbd598` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.376851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85c8c21b19e449eaa23f9f15edbd598)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.378279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.419267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd343f-f1fd-4a8f-bd95-58bedfe09964 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.437928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85c8c21b19e449eaa23f9f15edbd598', 'request_id': 'req-cbd0832f-6130-4873-9ffd-85076199dc5a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.444508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85c8c21b19e449eaa23f9f15edbd598', 'request_id': 'req-cbd0832f-6130-4873-9ffd-85076199dc5a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.451280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85c8c21b19e449eaa23f9f15edbd598', 'request_id': 'req-cbd0832f-6130-4873-9ffd-85076199dc5a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.473505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] The token cache is being invalidate because project e85c8c21b19e449eaa23f9f15edbd598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:26.473801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.474472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:26.476976 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1011/2014] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:26 2022] DELETE /identity/v3/projects/e85c8c21b19e449eaa23f9f15edbd598 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:26.480538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.480538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.490246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3b874-4494-492d-a88b-185086a01933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.491108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b874-4494-492d-a88b-185086a01933 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.491401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b874-4494-492d-a88b-185086a01933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.491684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b874-4494-492d-a88b-185086a01933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.492533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3b874-4494-492d-a88b-185086a01933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.494641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3b874-4494-492d-a88b-185086a01933 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.524099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1004/2015] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/projects => generated 399 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:26.525712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2005-051b-4ba3-9aa4-47533a844847 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.526081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2005-051b-4ba3-9aa4-47533a844847 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.526480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2005-051b-4ba3-9aa4-47533a844847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.547389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-85af2005-051b-4ba3-9aa4-47533a844847 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:26.548666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-85af2005-051b-4ba3-9aa4-47533a844847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.555799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0832f-6130-4873-9ffd-85076199dc5a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.604890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:26.624028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.624914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.625204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.625483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.626181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.628148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.630765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1005/2016] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:26.632300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1296f-a97e-411a-87c8-1e92d1a7c099 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.632730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1296f-a97e-411a-87c8-1e92d1a7c099 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.633269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1296f-a97e-411a-87c8-1e92d1a7c099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.658603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-dfb1296f-a97e-411a-87c8-1e92d1a7c099 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:26.659941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-dfb1296f-a97e-411a-87c8-1e92d1a7c099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.660948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1012/2017] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:26.661881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.665981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.700522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:26.737598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1006/2018] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:26.738776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0b62-ea02-4541-98ac-9aa81e8a8dee None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.739065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0b62-ea02-4541-98ac-9aa81e8a8dee None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.739369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0b62-ea02-4541-98ac-9aa81e8a8dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.746482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b1cc-7e22-41d4-91ed-208d14a1d257 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.753107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e594a4-f299-45c3-8702-ad1b0f08cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.753745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e594a4-f299-45c3-8702-ad1b0f08cd5a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.754031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e594a4-f299-45c3-8702-ad1b0f08cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.754362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e594a4-f299-45c3-8702-ad1b0f08cd5a admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.755208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e594a4-f299-45c3-8702-ad1b0f08cd5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.757915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2e6d0b62-ea02-4541-98ac-9aa81e8a8dee None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:26.758737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e594a4-f299-45c3-8702-ad1b0f08cd5a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.759126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2e6d0b62-ea02-4541-98ac-9aa81e8a8dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.768540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1007/2019] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:26.769368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d0b62-ea02-4541-98ac-9aa81e8a8dee None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.783797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d0b62-ea02-4541-98ac-9aa81e8a8dee None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.790288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ce032-8fd3-4cbd-a28a-1808e47a2755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.790971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ce032-8fd3-4cbd-a28a-1808e47a2755 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.791294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ce032-8fd3-4cbd-a28a-1808e47a2755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.791579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ce032-8fd3-4cbd-a28a-1808e47a2755 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.792498 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ce032-8fd3-4cbd-a28a-1808e47a2755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.796932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ce032-8fd3-4cbd-a28a-1808e47a2755 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.797460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1013/2020] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/users => generated 306 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:26.799524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f856bf-4a47-4601-97af-cb2e42c0ceb6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.800013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f856bf-4a47-4601-97af-cb2e42c0ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.800449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f856bf-4a47-4601-97af-cb2e42c0ceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.823943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-44f856bf-4a47-4601-97af-cb2e42c0ceb6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:26.825341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-44f856bf-4a47-4601-97af-cb2e42c0ceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:26.835668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1014/2021] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:26.836510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f856bf-4a47-4601-97af-cb2e42c0ceb6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.843044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1008/2022] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/users => generated 297 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:26.847134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ce032-8fd3-4cbd-a28a-1808e47a2755 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.849504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f856bf-4a47-4601-97af-cb2e42c0ceb6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.864508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ce032-8fd3-4cbd-a28a-1808e47a2755 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.866340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.867097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.867419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.868341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.869207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:26.869804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.871447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.873136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa4ac3-de49-47a6-8712-41f37c35785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.874291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa4ac3-de49-47a6-8712-41f37c35785d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.875562 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa4ac3-de49-47a6-8712-41f37c35785d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.876041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa4ac3-de49-47a6-8712-41f37c35785d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.877392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa4ac3-de49-47a6-8712-41f37c35785d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.880089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa4ac3-de49-47a6-8712-41f37c35785d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.886794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1015/2023] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:26.887829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.896927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1009/2024] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:26.898607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa4ac3-de49-47a6-8712-41f37c35785d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.901575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46d008-90c9-4a2b-9f6d-ad6f7ebeb29b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.907689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.908372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.908661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.908993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.909738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:26.910047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.910388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa4ac3-de49-47a6-8712-41f37c35785d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.911670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.916219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d914a9-8a74-42c0-9f65-5949a0c864c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.916928 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d914a9-8a74-42c0-9f65-5949a0c864c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.917210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d914a9-8a74-42c0-9f65-5949a0c864c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.917482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d914a9-8a74-42c0-9f65-5949a0c864c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.918207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d914a9-8a74-42c0-9f65-5949a0c864c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.919831 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d914a9-8a74-42c0-9f65-5949a0c864c8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.927905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1016/2025] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:26.930530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.936038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1010/2026] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:26.937032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d914a9-8a74-42c0-9f65-5949a0c864c8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.945230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7aec-7ac2-4042-a031-e7e08eadb235 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.950571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce94b72-1bdd-465d-b94a-46db9d9566e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.951329 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94b72-1bdd-465d-b94a-46db9d9566e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.951920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94b72-1bdd-465d-b94a-46db9d9566e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.952144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d914a9-8a74-42c0-9f65-5949a0c864c8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:26.952222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94b72-1bdd-465d-b94a-46db9d9566e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.953037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce94b72-1bdd-465d-b94a-46db9d9566e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.954970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce94b72-1bdd-465d-b94a-46db9d9566e9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.957299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddbf8c-1703-499b-b724-f078f8876ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:26.958214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddbf8c-1703-499b-b724-f078f8876ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:26.958635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddbf8c-1703-499b-b724-f078f8876ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:26.960916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddbf8c-1703-499b-b724-f078f8876ba3 admin admin] PATH_INFO: `/v3/projects/09813b28696d4f908b57d61cec6a3f11/users/e35f8dfa946948bfbad703649a0d9d8d/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:26.979287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddbf8c-1703-499b-b724-f078f8876ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09813b28696d4f908b57d61cec6a3f11, user_id=e35f8dfa946948bfbad703649a0d9d8d, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:26.981948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddbf8c-1703-499b-b724-f078f8876ba3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:26.987463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1017/2027] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:26.988392 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce94b72-1bdd-465d-b94a-46db9d9566e9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:26.998035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1011/2028] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:26 2022] PUT /identity/v3/projects/09813b28696d4f908b57d61cec6a3f11/users/e35f8dfa946948bfbad703649a0d9d8d/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:26.999294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddbf8c-1703-499b-b724-f078f8876ba3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.071865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce94b72-1bdd-465d-b94a-46db9d9566e9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.086868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:27.117796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddbf8c-1703-499b-b724-f078f8876ba3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.124302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7a5d-3004-46cc-8176-429cda821366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.126050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7a5d-3004-46cc-8176-429cda821366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.126050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7a5d-3004-46cc-8176-429cda821366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.126259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7a5d-3004-46cc-8176-429cda821366 admin admin] PATH_INFO: `/v3/projects/abe18f696c64460f8efe2ba6c239c05a/users/8c65728652d543498fc8217310808bbb/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.144062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7a5d-3004-46cc-8176-429cda821366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe18f696c64460f8efe2ba6c239c05a, user_id=8c65728652d543498fc8217310808bbb, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.147078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7a5d-3004-46cc-8176-429cda821366 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.157359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164265bd-1101-4939-b8ef-72658b15fb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.158118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164265bd-1101-4939-b8ef-72658b15fb7d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.158376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164265bd-1101-4939-b8ef-72658b15fb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.158672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164265bd-1101-4939-b8ef-72658b15fb7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.159401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164265bd-1101-4939-b8ef-72658b15fb7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.161501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164265bd-1101-4939-b8ef-72658b15fb7d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.165374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1012/2029] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:26 2022] PUT /identity/v3/projects/abe18f696c64460f8efe2ba6c239c05a/users/8c65728652d543498fc8217310808bbb/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:27.166204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7a5d-3004-46cc-8176-429cda821366 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.191172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1018/2030] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:26 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:27.192096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164265bd-1101-4939-b8ef-72658b15fb7d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.233336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:27.249463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7a5d-3004-46cc-8176-429cda821366 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.267117 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164265bd-1101-4939-b8ef-72658b15fb7d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.272447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2ca00-317f-41df-a4a4-fcb934ddada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.273161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2ca00-317f-41df-a4a4-fcb934ddada0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.273447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2ca00-317f-41df-a4a4-fcb934ddada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.273730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2ca00-317f-41df-a4a4-fcb934ddada0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.274462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2ca00-317f-41df-a4a4-fcb934ddada0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.276171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2ca00-317f-41df-a4a4-fcb934ddada0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.288100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1019/2031] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:27.289132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2ca00-317f-41df-a4a4-fcb934ddada0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.300576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2ca00-317f-41df-a4a4-fcb934ddada0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.306465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66964152-5995-402b-b26f-1fa0807d78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.306869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66964152-5995-402b-b26f-1fa0807d78c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.307155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66964152-5995-402b-b26f-1fa0807d78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.307610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66964152-5995-402b-b26f-1fa0807d78c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.308346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66964152-5995-402b-b26f-1fa0807d78c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.310324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66964152-5995-402b-b26f-1fa0807d78c0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.323755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1020/2032] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:27.324979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66964152-5995-402b-b26f-1fa0807d78c0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.342480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a561a-1c17-42f5-a93a-3ff955122b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.342480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a561a-1c17-42f5-a93a-3ff955122b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.342480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a561a-1c17-42f5-a93a-3ff955122b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.342480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a561a-1c17-42f5-a93a-3ff955122b1e admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.343033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a561a-1c17-42f5-a93a-3ff955122b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.343128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66964152-5995-402b-b26f-1fa0807d78c0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.343245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a561a-1c17-42f5-a93a-3ff955122b1e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.345194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af795d-329c-49a7-81fd-4ca8e9c22f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.346003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af795d-329c-49a7-81fd-4ca8e9c22f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.346332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af795d-329c-49a7-81fd-4ca8e9c22f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.346820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af795d-329c-49a7-81fd-4ca8e9c22f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.347772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af795d-329c-49a7-81fd-4ca8e9c22f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.350122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af795d-329c-49a7-81fd-4ca8e9c22f67 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.364942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1013/2033] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:27.366536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a561a-1c17-42f5-a93a-3ff955122b1e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.376715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a561a-1c17-42f5-a93a-3ff955122b1e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.377098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1021/2034] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:27.377961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af795d-329c-49a7-81fd-4ca8e9c22f67 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.382663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcd89-3874-4f11-85c8-b25929b0db9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.383570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcd89-3874-4f11-85c8-b25929b0db9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.383849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcd89-3874-4f11-85c8-b25929b0db9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.384125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcd89-3874-4f11-85c8-b25929b0db9e admin admin] PATH_INFO: `/v3/projects/09813b28696d4f908b57d61cec6a3f11/users/e35f8dfa946948bfbad703649a0d9d8d/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.386278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedcd89-3874-4f11-85c8-b25929b0db9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=09813b28696d4f908b57d61cec6a3f11, user_id=e35f8dfa946948bfbad703649a0d9d8d, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.388764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af795d-329c-49a7-81fd-4ca8e9c22f67 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.389038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedcd89-3874-4f11-85c8-b25929b0db9e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.394032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab3512-49c9-4106-b076-b6ee782a1fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.395005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab3512-49c9-4106-b076-b6ee782a1fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.395601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab3512-49c9-4106-b076-b6ee782a1fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.395725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab3512-49c9-4106-b076-b6ee782a1fcc admin admin] PATH_INFO: `/v3/projects/abe18f696c64460f8efe2ba6c239c05a/users/8c65728652d543498fc8217310808bbb/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.397868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab3512-49c9-4106-b076-b6ee782a1fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe18f696c64460f8efe2ba6c239c05a, user_id=8c65728652d543498fc8217310808bbb, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.400178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1014/2035] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:27 2022] PUT /identity/v3/projects/09813b28696d4f908b57d61cec6a3f11/users/e35f8dfa946948bfbad703649a0d9d8d/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:27.400525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab3512-49c9-4106-b076-b6ee782a1fcc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.401002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcd89-3874-4f11-85c8-b25929b0db9e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.411748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1022/2036] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:27 2022] PUT /identity/v3/projects/abe18f696c64460f8efe2ba6c239c05a/users/8c65728652d543498fc8217310808bbb/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:27.412657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab3512-49c9-4106-b076-b6ee782a1fcc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.473344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:27.476610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcd89-3874-4f11-85c8-b25929b0db9e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.481496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6946c2-e175-4320-9642-a381fae976b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.482255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6946c2-e175-4320-9642-a381fae976b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.482535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6946c2-e175-4320-9642-a381fae976b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.482819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6946c2-e175-4320-9642-a381fae976b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.483596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6946c2-e175-4320-9642-a381fae976b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.485171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6946c2-e175-4320-9642-a381fae976b8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.486167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab3512-49c9-4106-b076-b6ee782a1fcc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.491947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b057c8-c83b-4c98-b11b-93be10da68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.492650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b057c8-c83b-4c98-b11b-93be10da68a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.492969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b057c8-c83b-4c98-b11b-93be10da68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.493252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b057c8-c83b-4c98-b11b-93be10da68a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.493982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b057c8-c83b-4c98-b11b-93be10da68a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.495629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b057c8-c83b-4c98-b11b-93be10da68a6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.495750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1015/2037] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:27.498166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d16685-b108-4fe2-9fe5-1953163f6726 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.498479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d16685-b108-4fe2-9fe5-1953163f6726 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.498762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d16685-b108-4fe2-9fe5-1953163f6726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.507227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1023/2038] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:27.508473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92430-b1c0-4414-86e8-176baa9ae431 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.508855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92430-b1c0-4414-86e8-176baa9ae431 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.509200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92430-b1c0-4414-86e8-176baa9ae431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.525511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-86d16685-b108-4fe2-9fe5-1953163f6726 None None] MFA Rules not processed for user `e35f8dfa946948bfbad703649a0d9d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:27.526736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-86d16685-b108-4fe2-9fe5-1953163f6726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.535525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d6b92430-b1c0-4414-86e8-176baa9ae431 None None] MFA Rules not processed for user `8c65728652d543498fc8217310808bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:27.536696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d6b92430-b1c0-4414-86e8-176baa9ae431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.587886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:27.598284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1016/2039] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:27.599089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d16685-b108-4fe2-9fe5-1953163f6726 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.610314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d16685-b108-4fe2-9fe5-1953163f6726 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.610771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1024/2040] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:27.611598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92430-b1c0-4414-86e8-176baa9ae431 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.619605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.620219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.620540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.620776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.621611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.621981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92430-b1c0-4414-86e8-176baa9ae431 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.623363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.627045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.628289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.628568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.628849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.630046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.631625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.637200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1017/2041] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:27.637200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.637200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.641752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1025/2042] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:27.643000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.644708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.696213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f2a6-7338-4de7-b405-0a64182993e9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.700155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53cd15-c6a5-4c6e-ab7c-787b6368b65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.700937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53cd15-c6a5-4c6e-ab7c-787b6368b65e service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.701499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53cd15-c6a5-4c6e-ab7c-787b6368b65e service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.701606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53cd15-c6a5-4c6e-ab7c-787b6368b65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.705837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4cd8-cde7-4fa9-98e7-c8e825cadcf3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.711880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf906e-83be-4e71-989f-eadadbe713e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.712042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53cd15-c6a5-4c6e-ab7c-787b6368b65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.713236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf906e-83be-4e71-989f-eadadbe713e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.713558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53cd15-c6a5-4c6e-ab7c-787b6368b65e service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.713674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf906e-83be-4e71-989f-eadadbe713e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.714094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf906e-83be-4e71-989f-eadadbe713e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.724549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1018/2043] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:27.725854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53cd15-c6a5-4c6e-ab7c-787b6368b65e service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.728841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf906e-83be-4e71-989f-eadadbe713e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.730621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf906e-83be-4e71-989f-eadadbe713e2 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.737368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53cd15-c6a5-4c6e-ab7c-787b6368b65e service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.742713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1026/2044] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:27.743485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c650-cc85-41e1-ab6b-006400d64090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.743912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf906e-83be-4e71-989f-eadadbe713e2 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.744731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c650-cc85-41e1-ab6b-006400d64090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.745201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c650-cc85-41e1-ab6b-006400d64090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.745626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c650-cc85-41e1-ab6b-006400d64090 admin admin] PATH_INFO: `/v3/projects/8a22e0eb930a4a72a622bc17f21dc7dc/users/64b7104af285411ab52c4b5e63e95df6/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.756085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf906e-83be-4e71-989f-eadadbe713e2 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:27.762373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb254b17-880c-43b3-a34d-3a1f0f8d518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:27.763463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254b17-880c-43b3-a34d-3a1f0f8d518e admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.764096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254b17-880c-43b3-a34d-3a1f0f8d518e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.764443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254b17-880c-43b3-a34d-3a1f0f8d518e admin admin] PATH_INFO: `/v3/projects/7d696eb8cb2145ae8b284e6668cffd0f/users/680b1ddd26124fae932942ec3f44c1c8/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.765898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5c650-cc85-41e1-ab6b-006400d64090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a22e0eb930a4a72a622bc17f21dc7dc, user_id=64b7104af285411ab52c4b5e63e95df6, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.769587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5c650-cc85-41e1-ab6b-006400d64090 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.788206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb254b17-880c-43b3-a34d-3a1f0f8d518e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d696eb8cb2145ae8b284e6668cffd0f, user_id=680b1ddd26124fae932942ec3f44c1c8, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:27.791565 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb254b17-880c-43b3-a34d-3a1f0f8d518e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:27.797079 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1019/2045] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:27 2022] PUT /identity/v3/projects/8a22e0eb930a4a72a622bc17f21dc7dc/users/64b7104af285411ab52c4b5e63e95df6/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:27.808973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226e1ab-350d-4a9b-8710-ba7d8e6b5600 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.809705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226e1ab-350d-4a9b-8710-ba7d8e6b5600 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.810154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226e1ab-350d-4a9b-8710-ba7d8e6b5600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.821126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1027/2046] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:27 2022] PUT /identity/v3/projects/7d696eb8cb2145ae8b284e6668cffd0f/users/680b1ddd26124fae932942ec3f44c1c8/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:27.824775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013cb2b-4dc3-4f8a-9430-a3a69a58196b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:27.825379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013cb2b-4dc3-4f8a-9430-a3a69a58196b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:27.828020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013cb2b-4dc3-4f8a-9430-a3a69a58196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:27.841806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e226e1ab-350d-4a9b-8710-ba7d8e6b5600 None None] MFA Rules not processed for user `64b7104af285411ab52c4b5e63e95df6`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:27.843308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e226e1ab-350d-4a9b-8710-ba7d8e6b5600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.853419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d013cb2b-4dc3-4f8a-9430-a3a69a58196b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:27.854803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d013cb2b-4dc3-4f8a-9430-a3a69a58196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:27.913406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:27.930722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1020/2047] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:27.934967 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226e1ab-350d-4a9b-8710-ba7d8e6b5600 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.955827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1028/2048] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:27.968541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013cb2b-4dc3-4f8a-9430-a3a69a58196b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:27.970035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d013cb2b-4dc3-4f8a-9430-a3a69a58196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:28.022801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226e1ab-350d-4a9b-8710-ba7d8e6b5600 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.026452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb0903-979c-48e0-8854-282292929268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.027167 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb0903-979c-48e0-8854-282292929268 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.027448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb0903-979c-48e0-8854-282292929268 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.027728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb0903-979c-48e0-8854-282292929268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.030242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e9cb0903-979c-48e0-8854-282292929268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:28.038093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:28.051137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013cb2b-4dc3-4f8a-9430-a3a69a58196b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.055658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5143fd-15f5-4603-94e1-3007afa5b10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.056306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5143fd-15f5-4603-94e1-3007afa5b10c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.056591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5143fd-15f5-4603-94e1-3007afa5b10c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.056917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5143fd-15f5-4603-94e1-3007afa5b10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.068463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5143fd-15f5-4603-94e1-3007afa5b10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.070918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5143fd-15f5-4603-94e1-3007afa5b10c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.080727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1029/2049] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:28.081650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5143fd-15f5-4603-94e1-3007afa5b10c service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:28.090644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5143fd-15f5-4603-94e1-3007afa5b10c service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:28.095086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cfb41-6ce5-4bf2-bbe5-82b0b13c84ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:28.095661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cfb41-6ce5-4bf2-bbe5-82b0b13c84ed service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:28.095938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cfb41-6ce5-4bf2-bbe5-82b0b13c84ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:28.096577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cfb41-6ce5-4bf2-bbe5-82b0b13c84ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:28.105315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cfb41-6ce5-4bf2-bbe5-82b0b13c84ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.105603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb0903-979c-48e0-8854-282292929268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:28.107175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cfb41-6ce5-4bf2-bbe5-82b0b13c84ed service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.107330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb0903-979c-48e0-8854-282292929268 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:28.121360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1030/2050] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:28.124954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1021/2051] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:29.279077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cfb41-6ce5-4bf2-bbe5-82b0b13c84ed service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.298425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cfb41-6ce5-4bf2-bbe5-82b0b13c84ed service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.298425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.299649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.300621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.300621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] PATH_INFO: `/v3/users/c4936b751ccb445ba11ad221194ae26b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.301885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4936b751ccb445ba11ad221194ae26b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.305957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:29.347166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3dc0-f576-4426-850b-ca04d4e4b071 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.347695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3dc0-f576-4426-850b-ca04d4e4b071 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.347773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c3dc0-f576-4426-850b-ca04d4e4b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.389816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4936b751ccb445ba11ad221194ae26b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.391485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5e8c3dc0-f576-4426-850b-ca04d4e4b071 None None] MFA Rules not processed for user `680b1ddd26124fae932942ec3f44c1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:29.394365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5e8c3dc0-f576-4426-850b-ca04d4e4b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:29.408498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4936b751ccb445ba11ad221194ae26b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.421319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4936b751ccb445ba11ad221194ae26b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.422114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4936b751ccb445ba11ad221194ae26b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.422742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-745d8c4e-e45b-47e9-8e69-0102487a0254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4936b751ccb445ba11ad221194ae26b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:29.441794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1031/2052] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:29 2022] DELETE /identity/v3/users/c4936b751ccb445ba11ad221194ae26b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:29.448729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cde17-4826-4b68-8b55-dacad52258e0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.450510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cde17-4826-4b68-8b55-dacad52258e0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.450802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cde17-4826-4b68-8b55-dacad52258e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.482864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e26cde17-4826-4b68-8b55-dacad52258e0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:29.484466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e26cde17-4826-4b68-8b55-dacad52258e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:29.499978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1022/2053] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:29.501910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3dc0-f576-4426-850b-ca04d4e4b071 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.503701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5e8c3dc0-f576-4426-850b-ca04d4e4b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:29.521553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c3dc0-f576-4426-850b-ca04d4e4b071 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.534073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:29.565538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1032/2054] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:29.576324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cde17-4826-4b68-8b55-dacad52258e0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.577630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e26cde17-4826-4b68-8b55-dacad52258e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:29.621606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebbce6-172e-45d3-a79a-f8a00eccf534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.622857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebbce6-172e-45d3-a79a-f8a00eccf534 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.623459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebbce6-172e-45d3-a79a-f8a00eccf534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.624239 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebbce6-172e-45d3-a79a-f8a00eccf534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.625780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebbce6-172e-45d3-a79a-f8a00eccf534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.627893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebbce6-172e-45d3-a79a-f8a00eccf534 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:29.667285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cde17-4826-4b68-8b55-dacad52258e0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.669929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1023/2055] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:29 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:29.675267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebbce6-172e-45d3-a79a-f8a00eccf534 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.708464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:29.741844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143fce7-8ded-461d-966d-08b778cfa699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.742573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143fce7-8ded-461d-966d-08b778cfa699 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.742827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143fce7-8ded-461d-966d-08b778cfa699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.743240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143fce7-8ded-461d-966d-08b778cfa699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.759314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebbce6-172e-45d3-a79a-f8a00eccf534 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.771036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2657d-7893-4d47-8dfe-2eaf157071b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.773190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2657d-7893-4d47-8dfe-2eaf157071b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.774266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2657d-7893-4d47-8dfe-2eaf157071b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.774767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143fce7-8ded-461d-966d-08b778cfa699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.775463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2657d-7893-4d47-8dfe-2eaf157071b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.779350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2657d-7893-4d47-8dfe-2eaf157071b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.780743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143fce7-8ded-461d-966d-08b778cfa699 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:29.788146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2657d-7893-4d47-8dfe-2eaf157071b6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:29.794846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1033/2056] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:29.854493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1024/2057] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:29 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:29.857422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143fce7-8ded-461d-966d-08b778cfa699 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.872620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143fce7-8ded-461d-966d-08b778cfa699 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.878915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92873-68ee-4894-80ed-8c0f1e9d3af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.879769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92873-68ee-4894-80ed-8c0f1e9d3af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.880928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92873-68ee-4894-80ed-8c0f1e9d3af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.881333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92873-68ee-4894-80ed-8c0f1e9d3af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.882957 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b92873-68ee-4894-80ed-8c0f1e9d3af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.885837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b92873-68ee-4894-80ed-8c0f1e9d3af2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:29.901241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1034/2058] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:29.905803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2657d-7893-4d47-8dfe-2eaf157071b6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:29.923066 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2657d-7893-4d47-8dfe-2eaf157071b6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:29.932980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe99a4d-3cd7-46ef-a44d-d489b7f3b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:29.935377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99a4d-3cd7-46ef-a44d-d489b7f3b431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:29.936419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99a4d-3cd7-46ef-a44d-d489b7f3b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:29.936948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99a4d-3cd7-46ef-a44d-d489b7f3b431 admin admin] PATH_INFO: `/v3/projects/68ccba190b6c49c7a505092b1ecb46c4/users/9a4c12cdb4df40bfbaca69da46130ef3/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:29.966243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe99a4d-3cd7-46ef-a44d-d489b7f3b431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ccba190b6c49c7a505092b1ecb46c4, user_id=9a4c12cdb4df40bfbaca69da46130ef3, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:29.971747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe99a4d-3cd7-46ef-a44d-d489b7f3b431 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.003742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1025/2059] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:29 2022] PUT /identity/v3/projects/68ccba190b6c49c7a505092b1ecb46c4/users/9a4c12cdb4df40bfbaca69da46130ef3/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:30.009814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92873-68ee-4894-80ed-8c0f1e9d3af2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:30.025447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92873-68ee-4894-80ed-8c0f1e9d3af2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.110531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.111356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.111964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.112356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.113945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.117108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.144589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1035/2060] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:30.145877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe99a4d-3cd7-46ef-a44d-d489b7f3b431 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:30.173246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe99a4d-3cd7-46ef-a44d-d489b7f3b431 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.185125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.186388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.186841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.187201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] PATH_INFO: `/v3/projects/68ccba190b6c49c7a505092b1ecb46c4/users/9a4c12cdb4df40bfbaca69da46130ef3/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.190559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ccba190b6c49c7a505092b1ecb46c4, user_id=9a4c12cdb4df40bfbaca69da46130ef3, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.195168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.216339 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1026/2061] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:30 2022] PUT /identity/v3/projects/68ccba190b6c49c7a505092b1ecb46c4/users/9a4c12cdb4df40bfbaca69da46130ef3/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:30.324290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:30.326723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:30.350987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e808-3f64-4502-b457-bd15f0cb75f7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.399915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:30.446409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.447290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.447574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.447853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] PATH_INFO: `/v3/projects/522dd1c0bcbe494d8b167968aa5b5436` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.449081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522dd1c0bcbe494d8b167968aa5b5436)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.451231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.510303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522dd1c0bcbe494d8b167968aa5b5436', 'request_id': 'req-429b0613-409f-4bb8-a78e-5adf0e591413'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.516639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522dd1c0bcbe494d8b167968aa5b5436', 'request_id': 'req-429b0613-409f-4bb8-a78e-5adf0e591413'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.524083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522dd1c0bcbe494d8b167968aa5b5436', 'request_id': 'req-429b0613-409f-4bb8-a78e-5adf0e591413'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.538759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] The token cache is being invalidate because project 522dd1c0bcbe494d8b167968aa5b5436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:30.539049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.539802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.541410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1036/2062] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:30 2022] DELETE /identity/v3/projects/522dd1c0bcbe494d8b167968aa5b5436 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:30.545407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:30.547678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:30.560599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a4762-bc79-4c17-bcc8-b7bf8f65f44f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:30.628615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:30.629678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:30.629924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:30.630207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] PATH_INFO: `/v3/users/8c65728652d543498fc8217310808bbb` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:30.632226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c65728652d543498fc8217310808bbb)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:30.634407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:30.687578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c65728652d543498fc8217310808bbb'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.699460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c65728652d543498fc8217310808bbb'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.700347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c65728652d543498fc8217310808bbb'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.713901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c65728652d543498fc8217310808bbb'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.714883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b106c0e4-6a76-4a62-a54b-20616c388df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c65728652d543498fc8217310808bbb'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:30.721863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:30.732430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1027/2063] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:30 2022] DELETE /identity/v3/users/8c65728652d543498fc8217310808bbb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:31.014912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.026545 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0613-409f-4bb8-a78e-5adf0e591413 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.093323 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.094315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.094665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.095011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] PATH_INFO: `/v3/projects/abe18f696c64460f8efe2ba6c239c05a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.096374 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe18f696c64460f8efe2ba6c239c05a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.098464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.148230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe18f696c64460f8efe2ba6c239c05a', 'request_id': 'req-836a6fc0-1195-4188-813a-2ce8be15f70a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:31.154417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe18f696c64460f8efe2ba6c239c05a', 'request_id': 'req-836a6fc0-1195-4188-813a-2ce8be15f70a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:31.155873 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:31.164927 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe18f696c64460f8efe2ba6c239c05a', 'request_id': 'req-836a6fc0-1195-4188-813a-2ce8be15f70a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:31.181482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] The token cache is being invalidate because project abe18f696c64460f8efe2ba6c239c05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:31.181868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:31.182605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-836a6fc0-1195-4188-813a-2ce8be15f70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:31.184205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1037/2064] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:31 2022] DELETE /identity/v3/projects/abe18f696c64460f8efe2ba6c239c05a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:31.188992 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d7717-875b-44bd-a9de-48ea51dcf58e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.189287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d7717-875b-44bd-a9de-48ea51dcf58e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.189570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d7717-875b-44bd-a9de-48ea51dcf58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.208327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-981d7717-875b-44bd-a9de-48ea51dcf58e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:31.209505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-981d7717-875b-44bd-a9de-48ea51dcf58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:31.283510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1028/2065] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:31.290638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16becd10-bc40-4d40-98c8-e742979fe675 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.290888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16becd10-bc40-4d40-98c8-e742979fe675 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.291175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16becd10-bc40-4d40-98c8-e742979fe675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.320003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-16becd10-bc40-4d40-98c8-e742979fe675 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:31.321442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-16becd10-bc40-4d40-98c8-e742979fe675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:31.334753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1038/2066] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:31.335837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d7717-875b-44bd-a9de-48ea51dcf58e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.347825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d7717-875b-44bd-a9de-48ea51dcf58e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.363361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.363934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.364509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.364509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.365232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:31.365534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.367744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.395405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1029/2067] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:37:31.400056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16becd10-bc40-4d40-98c8-e742979fe675 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.418668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16becd10-bc40-4d40-98c8-e742979fe675 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.445069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bf7b0-b362-4425-967a-d22947689c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.447524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf7b0-b362-4425-967a-d22947689c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.448933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf7b0-b362-4425-967a-d22947689c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.449409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf7b0-b362-4425-967a-d22947689c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.453097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bf7b0-b362-4425-967a-d22947689c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.459060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bf7b0-b362-4425-967a-d22947689c00 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.509686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1039/2068] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:31 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:31.513456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.532948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784881c-ea78-4faf-9d56-e6f891625d8b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.618340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7994-8d3c-4933-a377-822e237b2a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.619118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7994-8d3c-4933-a377-822e237b2a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.619398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7994-8d3c-4933-a377-822e237b2a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.619673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7994-8d3c-4933-a377-822e237b2a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.620379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe7994-8d3c-4933-a377-822e237b2a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.628888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe7994-8d3c-4933-a377-822e237b2a15 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.670211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1030/2069] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:31 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:31.674289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bf7b0-b362-4425-967a-d22947689c00 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.703121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bf7b0-b362-4425-967a-d22947689c00 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.718542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b17837-1956-42e4-8ecf-f6687f1ac393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.721233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17837-1956-42e4-8ecf-f6687f1ac393 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.724576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17837-1956-42e4-8ecf-f6687f1ac393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.726893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17837-1956-42e4-8ecf-f6687f1ac393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.729406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b17837-1956-42e4-8ecf-f6687f1ac393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.733021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b17837-1956-42e4-8ecf-f6687f1ac393 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.766661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1040/2070] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:31.767767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7994-8d3c-4933-a377-822e237b2a15 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.791579 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7994-8d3c-4933-a377-822e237b2a15 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.811485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76779a8e-4dfd-4c4e-ae8d-925cc376a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.812176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76779a8e-4dfd-4c4e-ae8d-925cc376a74a admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.812633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76779a8e-4dfd-4c4e-ae8d-925cc376a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.812916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76779a8e-4dfd-4c4e-ae8d-925cc376a74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.813891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76779a8e-4dfd-4c4e-ae8d-925cc376a74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.815666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76779a8e-4dfd-4c4e-ae8d-925cc376a74a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.865648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f1951-798a-41cd-b669-63e43a0e1811 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.866451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f1951-798a-41cd-b669-63e43a0e1811 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.866934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f1951-798a-41cd-b669-63e43a0e1811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.873564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1031/2071] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:31.877784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76779a8e-4dfd-4c4e-ae8d-925cc376a74a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:31.903294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76779a8e-4dfd-4c4e-ae8d-925cc376a74a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:31.919814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:31.923779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:31.924479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:31.924780 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] PATH_INFO: `/v3/projects/a10af26b912e4a9dac26007a9126dbd2/users/86b4bfd09dbf433eb7723c6e5ee10dbd/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:31.937313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a19f1951-798a-41cd-b669-63e43a0e1811 None None] MFA Rules not processed for user `9a4c12cdb4df40bfbaca69da46130ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:31.938679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a19f1951-798a-41cd-b669-63e43a0e1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:31.954901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10af26b912e4a9dac26007a9126dbd2, user_id=86b4bfd09dbf433eb7723c6e5ee10dbd, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:31.957723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:31.999550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1032/2072] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:31 2022] PUT /identity/v3/projects/a10af26b912e4a9dac26007a9126dbd2/users/86b4bfd09dbf433eb7723c6e5ee10dbd/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:32.002487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.011136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.116712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1041/2073] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:32.120112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3f8cc-5852-43bf-88aa-cd9b732ca836 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.123373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3f8cc-5852-43bf-88aa-cd9b732ca836 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.124706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3f8cc-5852-43bf-88aa-cd9b732ca836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.175300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:32.217589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f0e3f8cc-5852-43bf-88aa-cd9b732ca836 None None] MFA Rules not processed for user `86b4bfd09dbf433eb7723c6e5ee10dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:32.220496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f0e3f8cc-5852-43bf-88aa-cd9b732ca836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.256864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4dc0-ae7f-4eff-9d9b-9ef9c7a788ec admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.265574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.266620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.266909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.267770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] PATH_INFO: `/v3/users/2191ab27f66e4bdda37d70cdfa541b2a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.270078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] RBAC: Authorizing `identity:delete_user(user_id=2191ab27f66e4bdda37d70cdfa541b2a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:32.272174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:32.388777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2191ab27f66e4bdda37d70cdfa541b2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.424224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1042/2074] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:32.426127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25b63-6e95-407d-8e60-008cb91b3760 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.426497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25b63-6e95-407d-8e60-008cb91b3760 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.427017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f25b63-6e95-407d-8e60-008cb91b3760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.439597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2191ab27f66e4bdda37d70cdfa541b2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.440604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2191ab27f66e4bdda37d70cdfa541b2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.452147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2191ab27f66e4bdda37d70cdfa541b2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.453288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2191ab27f66e4bdda37d70cdfa541b2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.462630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c6f25b63-6e95-407d-8e60-008cb91b3760 None None] MFA Rules not processed for user `680b1ddd26124fae932942ec3f44c1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:32.464230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c6f25b63-6e95-407d-8e60-008cb91b3760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.486332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1033/2075] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:31 2022] DELETE /identity/v3/users/2191ab27f66e4bdda37d70cdfa541b2a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:32.487407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.488969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.504215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:32.572343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f416a-446c-4662-b4eb-f10c947adfde admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.579178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.581294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.582598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.583494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.587166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.610091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1043/2076] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:32.620774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1fcd-986b-435d-a191-9738a2bb5bc7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.621664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1fcd-986b-435d-a191-9738a2bb5bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.622226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1fcd-986b-435d-a191-9738a2bb5bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.660184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ee5e1fcd-986b-435d-a191-9738a2bb5bc7 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:32.663250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ee5e1fcd-986b-435d-a191-9738a2bb5bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.738279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:32.740121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:32.753852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1034/2077] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:32.754916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.759634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.769058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1044/2078] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:32.776640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1fcd-986b-435d-a191-9738a2bb5bc7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.778247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ee5e1fcd-986b-435d-a191-9738a2bb5bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.796153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:32.809226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1fcd-986b-435d-a191-9738a2bb5bc7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.822776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.823674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.823951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.824223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] PATH_INFO: `/v3/users/86b4bfd09dbf433eb7723c6e5ee10dbd` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.825911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b4bfd09dbf433eb7723c6e5ee10dbd)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:32.829448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:32.898145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b4bfd09dbf433eb7723c6e5ee10dbd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.916207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b4bfd09dbf433eb7723c6e5ee10dbd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.920553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52287a-53aa-4232-8a42-37690f7c98c9 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:32.926417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8315548-801c-4319-949a-e9dd2533b0bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:32.927046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b4bfd09dbf433eb7723c6e5ee10dbd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.927207 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8315548-801c-4319-949a-e9dd2533b0bb service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:32.927400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8315548-801c-4319-949a-e9dd2533b0bb service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:32.927614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8315548-801c-4319-949a-e9dd2533b0bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:32.928692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b4bfd09dbf433eb7723c6e5ee10dbd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.929932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b4bfd09dbf433eb7723c6e5ee10dbd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:32.930929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c8315548-801c-4319-949a-e9dd2533b0bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:32.950417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1045/2079] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:32 2022] DELETE /identity/v3/users/86b4bfd09dbf433eb7723c6e5ee10dbd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:32.951836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:32.954112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.039911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:33.071834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b057-5729-4b49-bd0b-0e4f919a9b87 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.080394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.081206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.081605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.081964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.083499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8315548-801c-4319-949a-e9dd2533b0bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.084086 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.086695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8315548-801c-4319-949a-e9dd2533b0bb service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.100226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1035/2080] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:33.102405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4a5f-e0f5-40e0-a428-fb4e9db70de5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.103337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4a5f-e0f5-40e0-a428-fb4e9db70de5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.103769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b4a5f-e0f5-40e0-a428-fb4e9db70de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.139900 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e32b4a5f-e0f5-40e0-a428-fb4e9db70de5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:33.141463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e32b4a5f-e0f5-40e0-a428-fb4e9db70de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.272153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1036/2081] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:33.280147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.283333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4a5f-e0f5-40e0-a428-fb4e9db70de5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.283485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.284919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e32b4a5f-e0f5-40e0-a428-fb4e9db70de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.306602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b4a5f-e0f5-40e0-a428-fb4e9db70de5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.310244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1046/2082] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:33.316278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913a7ac-4e63-43fa-be61-a8e0c0a54d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.317145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a7ac-4e63-43fa-be61-a8e0c0a54d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.317431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a7ac-4e63-43fa-be61-a8e0c0a54d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.317710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a7ac-4e63-43fa-be61-a8e0c0a54d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.339394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913a7ac-4e63-43fa-be61-a8e0c0a54d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.341031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913a7ac-4e63-43fa-be61-a8e0c0a54d19 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.366730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1037/2083] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:33.454733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.458798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.478521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d176831-1455-4c8a-a723-9dfb002ac568 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.487047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.488715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.489175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.490202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] PATH_INFO: `/v3/users/d67ebbcdbcd14e0c880618d5a16db4d0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.492780 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67ebbcdbcd14e0c880618d5a16db4d0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.495453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.579614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67ebbcdbcd14e0c880618d5a16db4d0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:33.593878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67ebbcdbcd14e0c880618d5a16db4d0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:33.603477 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67ebbcdbcd14e0c880618d5a16db4d0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:33.604199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67ebbcdbcd14e0c880618d5a16db4d0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:33.604932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67ebbcdbcd14e0c880618d5a16db4d0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:33.625749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1047/2084] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:33 2022] DELETE /identity/v3/users/d67ebbcdbcd14e0c880618d5a16db4d0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:33.630466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa847-ca55-4882-af41-b2e7b60cb673 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.630821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa847-ca55-4882-af41-b2e7b60cb673 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.631134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa847-ca55-4882-af41-b2e7b60cb673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.664168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3b8aa847-ca55-4882-af41-b2e7b60cb673 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:33.665577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3b8aa847-ca55-4882-af41-b2e7b60cb673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.744191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:33.823568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1038/2085] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:33.845209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.846744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.895769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8aa847-ca55-4882-af41-b2e7b60cb673 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:33.897418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3b8aa847-ca55-4882-af41-b2e7b60cb673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:33.932577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8aa847-ca55-4882-af41-b2e7b60cb673 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.950215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.952606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:33.952945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:33.954127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] PATH_INFO: `/v3/projects/a10af26b912e4a9dac26007a9126dbd2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:33.958683 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10af26b912e4a9dac26007a9126dbd2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:33.963061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:33.989332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7dc3-38ff-40a0-92cc-ead725c35e82 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:33.997172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b3224-9002-4385-84ab-d61803f489c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:33.999445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3224-9002-4385-84ab-d61803f489c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.001100 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3224-9002-4385-84ab-d61803f489c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.001660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3224-9002-4385-84ab-d61803f489c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.033222 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b3224-9002-4385-84ab-d61803f489c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.035601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b3224-9002-4385-84ab-d61803f489c7 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.054666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1048/2086] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:34.099592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10af26b912e4a9dac26007a9126dbd2', 'request_id': 'req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.108862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10af26b912e4a9dac26007a9126dbd2', 'request_id': 'req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.115465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10af26b912e4a9dac26007a9126dbd2', 'request_id': 'req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.139269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] The token cache is being invalidate because project a10af26b912e4a9dac26007a9126dbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:34.139565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.140313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.144902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1039/2087] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:33 2022] DELETE /identity/v3/projects/a10af26b912e4a9dac26007a9126dbd2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:34.147409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da8b6-744f-4bf1-8e90-63f924f6eee0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.147691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da8b6-744f-4bf1-8e90-63f924f6eee0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.147969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da8b6-744f-4bf1-8e90-63f924f6eee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.157769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:34.172580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f05da8b6-744f-4bf1-8e90-63f924f6eee0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:34.175239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f05da8b6-744f-4bf1-8e90-63f924f6eee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.237577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.239842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.272615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1049/2088] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:34.281723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967641cd-8ecb-4f14-ab68-2c00b6f09d70 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.282209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967641cd-8ecb-4f14-ab68-2c00b6f09d70 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.282470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967641cd-8ecb-4f14-ab68-2c00b6f09d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.325638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-967641cd-8ecb-4f14-ab68-2c00b6f09d70 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:34.328532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-967641cd-8ecb-4f14-ab68-2c00b6f09d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.345186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1050/2089] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:34.346672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967641cd-8ecb-4f14-ab68-2c00b6f09d70 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.366522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967641cd-8ecb-4f14-ab68-2c00b6f09d70 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.374408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.376326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.376626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.376941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.378191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:34.379010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.382830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.404760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1051/2090] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:34.406185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.421315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25444320-3197-41e5-846b-3896f3d1125d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.429678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536ad6-7544-41a7-abf5-1d845afa446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.430143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536ad6-7544-41a7-abf5-1d845afa446f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.430431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536ad6-7544-41a7-abf5-1d845afa446f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.430697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536ad6-7544-41a7-abf5-1d845afa446f admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.431401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21536ad6-7544-41a7-abf5-1d845afa446f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.433483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21536ad6-7544-41a7-abf5-1d845afa446f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.441490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7367e2-82f7-44d7-9db5-a7ecb13d34fa admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.457203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.458112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.458908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.459197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] PATH_INFO: `/v3/projects/2150f2220f224f3fa4a6813631096b10` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.460748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2150f2220f224f3fa4a6813631096b10)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.467880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.492419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1052/2091] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:34.498806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536ad6-7544-41a7-abf5-1d845afa446f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.575329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2150f2220f224f3fa4a6813631096b10', 'request_id': 'req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.586162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2150f2220f224f3fa4a6813631096b10', 'request_id': 'req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.594279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:34.596561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2150f2220f224f3fa4a6813631096b10', 'request_id': 'req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.599920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536ad6-7544-41a7-abf5-1d845afa446f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.619179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] The token cache is being invalidate because project 2150f2220f224f3fa4a6813631096b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:34.619598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.620335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.624821 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1040/2092] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:34 2022] DELETE /identity/v3/projects/2150f2220f224f3fa4a6813631096b10 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:34.625946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.627722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.670847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.671346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.671628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.671952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.672686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.675102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.699517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:34.709214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1053/2093] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:34 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:34.709214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.712280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.730335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1262af8-148a-4f6e-9995-0eb604bb6311 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.737161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.738188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.738475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.739743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] PATH_INFO: `/v3/projects/bbbe638f36b94399875aaf0fca59e12a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.742721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbe638f36b94399875aaf0fca59e12a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.744703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.777575 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8d15-8d65-4d10-af03-4e0bc5dfa3f8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:34.783230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:34.784132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:34.784679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:34.784679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] PATH_INFO: `/v3/users/600bb3c19853492fac247a9d9a868a0e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:34.786128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600bb3c19853492fac247a9d9a868a0e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:34.788377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:34.814066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbe638f36b94399875aaf0fca59e12a', 'request_id': 'req-6b24751d-f488-4768-9c02-1f8ae7828788'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.823908 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbe638f36b94399875aaf0fca59e12a', 'request_id': 'req-6b24751d-f488-4768-9c02-1f8ae7828788'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.834230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbe638f36b94399875aaf0fca59e12a', 'request_id': 'req-6b24751d-f488-4768-9c02-1f8ae7828788'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.859822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600bb3c19853492fac247a9d9a868a0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.860241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] The token cache is being invalidate because project bbbe638f36b94399875aaf0fca59e12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:34.860552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.861598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.863776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1054/2094] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:34 2022] DELETE /identity/v3/projects/bbbe638f36b94399875aaf0fca59e12a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:34.867145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.868440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.879515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600bb3c19853492fac247a9d9a868a0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.880313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600bb3c19853492fac247a9d9a868a0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.890416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600bb3c19853492fac247a9d9a868a0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.891550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600bb3c19853492fac247a9d9a868a0e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:34.908156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1041/2095] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:34 2022] DELETE /identity/v3/users/600bb3c19853492fac247a9d9a868a0e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:34.908927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:34.910464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:34.952559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24751d-f488-4768-9c02-1f8ae7828788 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.002198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f1377-cb1b-46a5-9913-b0790d81baa6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.011272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.013108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.013660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.014119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] PATH_INFO: `/v3/users/e35f8dfa946948bfbad703649a0d9d8d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.016518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35f8dfa946948bfbad703649a0d9d8d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.019248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.028578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:35.040332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.041053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.041653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.042084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.042954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.047123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.061372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1055/2096] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:35.065718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.067658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.089421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709cc6f-f973-41e2-bfd3-8e0956b7107e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.099244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35f8dfa946948bfbad703649a0d9d8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.103530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.104179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.104460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.104735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.105649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.107544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.114466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35f8dfa946948bfbad703649a0d9d8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.115291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35f8dfa946948bfbad703649a0d9d8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.124497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1056/2097] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:35.127070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.129376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.140934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35f8dfa946948bfbad703649a0d9d8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.141829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35f8dfa946948bfbad703649a0d9d8d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.147356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54403-5c09-4c53-ba40-4b5265a0177f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.153394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044594d-43fc-40c9-86a5-9717866ebe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.154619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044594d-43fc-40c9-86a5-9717866ebe14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.154906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044594d-43fc-40c9-86a5-9717866ebe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.155205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044594d-43fc-40c9-86a5-9717866ebe14 admin admin] PATH_INFO: `/v3/projects/3cfdd3078cce48ec9b297f2741945d3d/users/8c2e24af7c07437db4a8b33d34190a0f/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.170857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:35.175288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1042/2098] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:34 2022] DELETE /identity/v3/users/e35f8dfa946948bfbad703649a0d9d8d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:35.177082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.180174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044594d-43fc-40c9-86a5-9717866ebe14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfdd3078cce48ec9b297f2741945d3d, user_id=8c2e24af7c07437db4a8b33d34190a0f, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.184377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044594d-43fc-40c9-86a5-9717866ebe14 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.194175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.204315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1057/2099] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:35 2022] PUT /identity/v3/projects/3cfdd3078cce48ec9b297f2741945d3d/users/8c2e24af7c07437db4a8b33d34190a0f/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:35.214860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6506793-34d8-4b49-adce-c6eb5252f69a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.215695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6506793-34d8-4b49-adce-c6eb5252f69a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.216162 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6506793-34d8-4b49-adce-c6eb5252f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.262199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f6506793-34d8-4b49-adce-c6eb5252f69a None None] MFA Rules not processed for user `8c2e24af7c07437db4a8b33d34190a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:35.264478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f6506793-34d8-4b49-adce-c6eb5252f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.333659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651e9b9-27ae-432c-9f49-de46c69f53ac admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.376551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1058/2100] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:35.376551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6506793-34d8-4b49-adce-c6eb5252f69a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.378415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f6506793-34d8-4b49-adce-c6eb5252f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.441102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.442999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.443561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.443702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] PATH_INFO: `/v3/users/64b7104af285411ab52c4b5e63e95df6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.445213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b7104af285411ab52c4b5e63e95df6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.447834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.486494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6506793-34d8-4b49-adce-c6eb5252f69a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.494168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.495983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.495983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.495983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] PATH_INFO: `/v3/projects/9213ae86381747e49093834430d15167` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.496811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9213ae86381747e49093834430d15167)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.498813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.504558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:35.518456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b7104af285411ab52c4b5e63e95df6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.538960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b7104af285411ab52c4b5e63e95df6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.541015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b7104af285411ab52c4b5e63e95df6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.552921 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b7104af285411ab52c4b5e63e95df6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.553804 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b7104af285411ab52c4b5e63e95df6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.555917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9213ae86381747e49093834430d15167', 'request_id': 'req-58310f47-59e9-48d2-bc80-58edd111c6a8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.562667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9213ae86381747e49093834430d15167', 'request_id': 'req-58310f47-59e9-48d2-bc80-58edd111c6a8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.571127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1043/2101] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:35 2022] DELETE /identity/v3/users/64b7104af285411ab52c4b5e63e95df6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:35.571127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.571330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9213ae86381747e49093834430d15167', 'request_id': 'req-58310f47-59e9-48d2-bc80-58edd111c6a8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.571702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.588439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] The token cache is being invalidate because project 9213ae86381747e49093834430d15167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:35.589036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.590375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-58310f47-59e9-48d2-bc80-58edd111c6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.593121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1059/2102] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:35 2022] DELETE /identity/v3/projects/9213ae86381747e49093834430d15167 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:35.594404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a53dcf-022c-4fa7-b2d6-625d248c4e02 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.594688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a53dcf-022c-4fa7-b2d6-625d248c4e02 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.594962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a53dcf-022c-4fa7-b2d6-625d248c4e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.619936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d0a53dcf-022c-4fa7-b2d6-625d248c4e02 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:35.621455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d0a53dcf-022c-4fa7-b2d6-625d248c4e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.629858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:35.648955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c438d-e185-408b-8253-885c1b523a28 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.653490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.654321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.654609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.654882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.657083 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.720452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1060/2103] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:35.725940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7dac-2931-495d-8f3a-20ede2b9b78b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.726238 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7dac-2931-495d-8f3a-20ede2b9b78b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.726515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7dac-2931-495d-8f3a-20ede2b9b78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.743498 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.745032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.747164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5aeb7dac-2931-495d-8f3a-20ede2b9b78b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:35.748437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5aeb7dac-2931-495d-8f3a-20ede2b9b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.761225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1044/2104] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:35.761225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.761225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.766470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1061/2105] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:35.767538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb7dac-2931-495d-8f3a-20ede2b9b78b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:35.768985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5aeb7dac-2931-495d-8f3a-20ede2b9b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.787598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446cf28-6d0c-4d4c-8506-41f0b2eea74f service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.793786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.795236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.795601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.795957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] PATH_INFO: `/v3/projects/09813b28696d4f908b57d61cec6a3f11` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.797293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09813b28696d4f908b57d61cec6a3f11)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.800077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.849989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb7dac-2931-495d-8f3a-20ede2b9b78b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:35.854309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881a2a0-3724-4e5e-a2e3-d4290b63985f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:35.855343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881a2a0-3724-4e5e-a2e3-d4290b63985f service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.855657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881a2a0-3724-4e5e-a2e3-d4290b63985f service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.856042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881a2a0-3724-4e5e-a2e3-d4290b63985f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.867704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881a2a0-3724-4e5e-a2e3-d4290b63985f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:35.869517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881a2a0-3724-4e5e-a2e3-d4290b63985f service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:35.870347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09813b28696d4f908b57d61cec6a3f11', 'request_id': 'req-198764b4-8487-439f-833e-51ae6f5f0739'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.882306 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09813b28696d4f908b57d61cec6a3f11', 'request_id': 'req-198764b4-8487-439f-833e-51ae6f5f0739'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.889963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:35.893418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1062/2106] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:35.893418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956b8f-812b-4605-9551-60dcb2ab2cfb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.894900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956b8f-812b-4605-9551-60dcb2ab2cfb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.894900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956b8f-812b-4605-9551-60dcb2ab2cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.896073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09813b28696d4f908b57d61cec6a3f11', 'request_id': 'req-198764b4-8487-439f-833e-51ae6f5f0739'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.919392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] The token cache is being invalidate because project 09813b28696d4f908b57d61cec6a3f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:35.919681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.920494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-198764b4-8487-439f-833e-51ae6f5f0739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:35.922735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1045/2107] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:35 2022] DELETE /identity/v3/projects/09813b28696d4f908b57d61cec6a3f11 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:35.927038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb1098-214f-4dfe-a34e-2d87a2777602 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:35.927543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb1098-214f-4dfe-a34e-2d87a2777602 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:35.927996 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb1098-214f-4dfe-a34e-2d87a2777602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:35.943460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-03956b8f-812b-4605-9551-60dcb2ab2cfb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:35.946946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-03956b8f-812b-4605-9551-60dcb2ab2cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:35.953270 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-97bb1098-214f-4dfe-a34e-2d87a2777602 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:35.954932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-97bb1098-214f-4dfe-a34e-2d87a2777602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.087203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1046/2108] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:36.089529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e84c0e-94c9-4684-a2cf-54a0af31cef4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.090386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e84c0e-94c9-4684-a2cf-54a0af31cef4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.090774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e84c0e-94c9-4684-a2cf-54a0af31cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.110525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1063/2109] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:36.114827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03956b8f-812b-4605-9551-60dcb2ab2cfb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.134782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03956b8f-812b-4605-9551-60dcb2ab2cfb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.136193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f6e84c0e-94c9-4684-a2cf-54a0af31cef4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:36.139225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f6e84c0e-94c9-4684-a2cf-54a0af31cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.146197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.158088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.158478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.160107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.161269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:36.161813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.163795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.165964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1047/2110] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:36.171259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e84c0e-94c9-4684-a2cf-54a0af31cef4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.181232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1064/2111] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:37:36.185427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.199203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e84c0e-94c9-4684-a2cf-54a0af31cef4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.208345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870f73-6692-49e2-9ac9-fb11e3c8f646 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.213590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754e7d8-efa4-4ec7-86c6-d2ee92c958d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.214353 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754e7d8-efa4-4ec7-86c6-d2ee92c958d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.214630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754e7d8-efa4-4ec7-86c6-d2ee92c958d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.214900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754e7d8-efa4-4ec7-86c6-d2ee92c958d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.215707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754e7d8-efa4-4ec7-86c6-d2ee92c958d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.218990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754e7d8-efa4-4ec7-86c6-d2ee92c958d1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.225072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.226018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.226018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.226472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.227024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:36.227351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.230852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.261386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1065/2113] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:36.261552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1048/2113] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:37:36.262716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754e7d8-efa4-4ec7-86c6-d2ee92c958d1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.265177 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.282820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d3f05-314f-4d56-a3a8-9813a2b59302 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.291077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:36.365436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15196b-c6b4-41bd-a883-0b7c6dc9e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.366743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15196b-c6b4-41bd-a883-0b7c6dc9e3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.367038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15196b-c6b4-41bd-a883-0b7c6dc9e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.367432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15196b-c6b4-41bd-a883-0b7c6dc9e3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.368304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15196b-c6b4-41bd-a883-0b7c6dc9e3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.371008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15196b-c6b4-41bd-a883-0b7c6dc9e3d3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.374081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754e7d8-efa4-4ec7-86c6-d2ee92c958d1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.378912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7799d45-81a4-44bb-a9ae-79fc006351c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.380301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799d45-81a4-44bb-a9ae-79fc006351c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.380687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799d45-81a4-44bb-a9ae-79fc006351c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.381192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799d45-81a4-44bb-a9ae-79fc006351c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.382587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7799d45-81a4-44bb-a9ae-79fc006351c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.384849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7799d45-81a4-44bb-a9ae-79fc006351c2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.409092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1049/2114] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:36.413633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15196b-c6b4-41bd-a883-0b7c6dc9e3d3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.427138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15196b-c6b4-41bd-a883-0b7c6dc9e3d3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.432585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb886f3-40ca-4432-9736-f70a8e5846f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.433386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb886f3-40ca-4432-9736-f70a8e5846f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.433830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb886f3-40ca-4432-9736-f70a8e5846f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.434095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb886f3-40ca-4432-9736-f70a8e5846f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.435242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb886f3-40ca-4432-9736-f70a8e5846f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.437013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb886f3-40ca-4432-9736-f70a8e5846f3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.446137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1066/2115] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:36.447138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7799d45-81a4-44bb-a9ae-79fc006351c2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.450196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1050/2116] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:36.454311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb886f3-40ca-4432-9736-f70a8e5846f3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.469546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb886f3-40ca-4432-9736-f70a8e5846f3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.533852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:36.560787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7799d45-81a4-44bb-a9ae-79fc006351c2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.565524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.566232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.566631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.566784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.567496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.574482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b2a3-a701-4927-a2c3-44210b856b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.575440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b2a3-a701-4927-a2c3-44210b856b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.575440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b2a3-a701-4927-a2c3-44210b856b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.575733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b2a3-a701-4927-a2c3-44210b856b9e admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.576441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894b2a3-a701-4927-a2c3-44210b856b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.578503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894b2a3-a701-4927-a2c3-44210b856b9e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.578619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.614793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1051/2117] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:36.619600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.620533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1067/2118] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:36.621254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b2a3-a701-4927-a2c3-44210b856b9e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.625331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.640650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b2a3-a701-4927-a2c3-44210b856b9e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.644249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dceee2-8c2b-4836-936a-c5150dffa37f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.646563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76fb17-07f4-41e4-8fd3-196aaed3688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.647688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76fb17-07f4-41e4-8fd3-196aaed3688c admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.647977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76fb17-07f4-41e4-8fd3-196aaed3688c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.648263 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76fb17-07f4-41e4-8fd3-196aaed3688c admin admin] PATH_INFO: `/v3/projects/099ce2c649f34476bf722ea964a90d5c/users/4472f4a3149d4cd9807866c702b1dbb4/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.649921 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.651077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.651364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.652297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] PATH_INFO: `/v3/projects/8a22e0eb930a4a72a622bc17f21dc7dc` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.653617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a22e0eb930a4a72a622bc17f21dc7dc)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.655850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.668695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76fb17-07f4-41e4-8fd3-196aaed3688c admin admin] RBAC: Authorizing `identity:create_grant(project_id=099ce2c649f34476bf722ea964a90d5c, user_id=4472f4a3149d4cd9807866c702b1dbb4, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.672909 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76fb17-07f4-41e4-8fd3-196aaed3688c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.699808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1068/2119] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:36 2022] PUT /identity/v3/projects/099ce2c649f34476bf722ea964a90d5c/users/4472f4a3149d4cd9807866c702b1dbb4/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:36.706900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76fb17-07f4-41e4-8fd3-196aaed3688c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.738034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a22e0eb930a4a72a622bc17f21dc7dc', 'request_id': 'req-190a9596-4d46-4821-b0b5-697a5b164b9f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.753917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a22e0eb930a4a72a622bc17f21dc7dc', 'request_id': 'req-190a9596-4d46-4821-b0b5-697a5b164b9f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.759958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a22e0eb930a4a72a622bc17f21dc7dc', 'request_id': 'req-190a9596-4d46-4821-b0b5-697a5b164b9f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.790109 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] The token cache is being invalidate because project 8a22e0eb930a4a72a622bc17f21dc7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:36.790743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.791229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-190a9596-4d46-4821-b0b5-697a5b164b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:36.793777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1052/2120] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:36 2022] DELETE /identity/v3/projects/8a22e0eb930a4a72a622bc17f21dc7dc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:36.795266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea89861-8c08-449d-80c2-9fbdb1ac0bc4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.795564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea89861-8c08-449d-80c2-9fbdb1ac0bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.795939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea89861-8c08-449d-80c2-9fbdb1ac0bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.832180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9ea89861-8c08-449d-80c2-9fbdb1ac0bc4 None None] MFA Rules not processed for user `4472f4a3149d4cd9807866c702b1dbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:36.833439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9ea89861-8c08-449d-80c2-9fbdb1ac0bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.838189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76fb17-07f4-41e4-8fd3-196aaed3688c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.848331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:36.906718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.907391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.907675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.907953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.908677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.910410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.916820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1053/2121] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:36.918438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ff5e-9c47-4fb9-94da-b12ac239b2f4 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.918876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ff5e-9c47-4fb9-94da-b12ac239b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.919259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ff5e-9c47-4fb9-94da-b12ac239b2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.921670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1069/2122] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:36.925529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.929286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.940954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-80a6ff5e-9c47-4fb9-94da-b12ac239b2f4 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:36.942240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-80a6ff5e-9c47-4fb9-94da-b12ac239b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.942658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9e87e-bca8-4608-a3b7-34072b899ec5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:36.947833 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd86d7-4321-4548-a9cd-ba23a131f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:36.948607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd86d7-4321-4548-a9cd-ba23a131f7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.948903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd86d7-4321-4548-a9cd-ba23a131f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.949191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd86d7-4321-4548-a9cd-ba23a131f7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.949920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd86d7-4321-4548-a9cd-ba23a131f7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:36.951527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd86d7-4321-4548-a9cd-ba23a131f7aa admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:36.954166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1054/2123] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:36.954999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ff5e-9c47-4fb9-94da-b12ac239b2f4 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:36.963623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-80a6ff5e-9c47-4fb9-94da-b12ac239b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.964882 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1070/2124] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:36.966539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83879-581c-44ea-a521-11b0eb8158f8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:36.966836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83879-581c-44ea-a521-11b0eb8158f8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:36.967384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83879-581c-44ea-a521-11b0eb8158f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:36.989912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b3e83879-581c-44ea-a521-11b0eb8158f8 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:36.991166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b3e83879-581c-44ea-a521-11b0eb8158f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:36.999674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1071/2125] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:37.001905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e83879-581c-44ea-a521-11b0eb8158f8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.013888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e83879-581c-44ea-a521-11b0eb8158f8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.020464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1b0f-9fd0-4e94-b59a-c35153fda114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.021447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1b0f-9fd0-4e94-b59a-c35153fda114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.022396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1b0f-9fd0-4e94-b59a-c35153fda114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.022678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1b0f-9fd0-4e94-b59a-c35153fda114 admin admin] PATH_INFO: `/v3/projects/2bf495139a114aabb8364daf183019fa/users/95c690fe7fcb421c87df18f952f38ff7/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.028926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ff5e-9c47-4fb9-94da-b12ac239b2f4 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.032667 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4cfbe-1d7c-4c1d-b9d5-767482599412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.033429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4cfbe-1d7c-4c1d-b9d5-767482599412 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.033785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4cfbe-1d7c-4c1d-b9d5-767482599412 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.034309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4cfbe-1d7c-4c1d-b9d5-767482599412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.040922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:37.041613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d1b0f-9fd0-4e94-b59a-c35153fda114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf495139a114aabb8364daf183019fa, user_id=95c690fe7fcb421c87df18f952f38ff7, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.045290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4cfbe-1d7c-4c1d-b9d5-767482599412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.045559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d1b0f-9fd0-4e94-b59a-c35153fda114 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.046865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4cfbe-1d7c-4c1d-b9d5-767482599412 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.063404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1072/2126] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:36 2022] PUT /identity/v3/projects/2bf495139a114aabb8364daf183019fa/users/95c690fe7fcb421c87df18f952f38ff7/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:37.064336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1b0f-9fd0-4e94-b59a-c35153fda114 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.071872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1055/2127] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:37.082021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb1c69-c4d3-4ea3-be23-ed607449875a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.082323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb1c69-c4d3-4ea3-be23-ed607449875a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.082635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb1c69-c4d3-4ea3-be23-ed607449875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.117611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-58eb1c69-c4d3-4ea3-be23-ed607449875a None None] MFA Rules not processed for user `95c690fe7fcb421c87df18f952f38ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:37.120310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-58eb1c69-c4d3-4ea3-be23-ed607449875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:37.152315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1b0f-9fd0-4e94-b59a-c35153fda114 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.161446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.162883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.163643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.164004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.165587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:37.166157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.168611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.185750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1073/2128] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:37.197858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.212654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33a9e2-73cf-464a-bad0-46a8d25b8883 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.218361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef945-6bc8-47a8-a9f3-09f29ad90b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.218966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef945-6bc8-47a8-a9f3-09f29ad90b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.219253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef945-6bc8-47a8-a9f3-09f29ad90b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.219676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef945-6bc8-47a8-a9f3-09f29ad90b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.220363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef945-6bc8-47a8-a9f3-09f29ad90b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.222643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef945-6bc8-47a8-a9f3-09f29ad90b44 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.239033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1056/2129] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:37.245568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb1c69-c4d3-4ea3-be23-ed607449875a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.257297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb1c69-c4d3-4ea3-be23-ed607449875a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.270887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1074/2130] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:37 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:37.274739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef945-6bc8-47a8-a9f3-09f29ad90b44 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.278117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfece-f1a6-433f-8f6a-194492eea428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.280712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfece-f1a6-433f-8f6a-194492eea428 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.281718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfece-f1a6-433f-8f6a-194492eea428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.282018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfece-f1a6-433f-8f6a-194492eea428 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.282765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cfece-f1a6-433f-8f6a-194492eea428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.284735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cfece-f1a6-433f-8f6a-194492eea428 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.351615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1057/2131] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:37 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:37.352727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfece-f1a6-433f-8f6a-194492eea428 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.358551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:37.439112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef945-6bc8-47a8-a9f3-09f29ad90b44 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.453490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfece-f1a6-433f-8f6a-194492eea428 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.454745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1678-2bf1-4cb8-98a0-6d77524b4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.455439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1678-2bf1-4cb8-98a0-6d77524b4c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.455775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1678-2bf1-4cb8-98a0-6d77524b4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.456881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1678-2bf1-4cb8-98a0-6d77524b4c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.457720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1678-2bf1-4cb8-98a0-6d77524b4c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.460188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1678-2bf1-4cb8-98a0-6d77524b4c58 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.464213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd22ff-a8c7-4f2f-86b9-f6afb12dc96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.464919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd22ff-a8c7-4f2f-86b9-f6afb12dc96a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.465202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd22ff-a8c7-4f2f-86b9-f6afb12dc96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.465479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd22ff-a8c7-4f2f-86b9-f6afb12dc96a admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.466175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd22ff-a8c7-4f2f-86b9-f6afb12dc96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.473384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd22ff-a8c7-4f2f-86b9-f6afb12dc96a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.500802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1075/2132] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:37 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:37.505199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1678-2bf1-4cb8-98a0-6d77524b4c58 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.515788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1058/2133] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:37 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:37.515788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd22ff-a8c7-4f2f-86b9-f6afb12dc96a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.526008 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1678-2bf1-4cb8-98a0-6d77524b4c58 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.535201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd22ff-a8c7-4f2f-86b9-f6afb12dc96a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.544432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175365a2-1d82-4c1f-8caa-4f6c04ccdcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.546157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175365a2-1d82-4c1f-8caa-4f6c04ccdcef admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.547169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175365a2-1d82-4c1f-8caa-4f6c04ccdcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.548587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175365a2-1d82-4c1f-8caa-4f6c04ccdcef admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.549603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175365a2-1d82-4c1f-8caa-4f6c04ccdcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.550525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470bb1c-91fe-44c1-9ebd-4d0bcdd73c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.553031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470bb1c-91fe-44c1-9ebd-4d0bcdd73c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.555310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470bb1c-91fe-44c1-9ebd-4d0bcdd73c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.556362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175365a2-1d82-4c1f-8caa-4f6c04ccdcef admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.556915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470bb1c-91fe-44c1-9ebd-4d0bcdd73c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.559166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470bb1c-91fe-44c1-9ebd-4d0bcdd73c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.564617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470bb1c-91fe-44c1-9ebd-4d0bcdd73c42 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.587625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1076/2134] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:37.589904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175365a2-1d82-4c1f-8caa-4f6c04ccdcef admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.604254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1059/2135] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:37.607448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470bb1c-91fe-44c1-9ebd-4d0bcdd73c42 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.613190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175365a2-1d82-4c1f-8caa-4f6c04ccdcef admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.623439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546416-02ca-4b41-a62e-b5074e3d04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.626579 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546416-02ca-4b41-a62e-b5074e3d04f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.628306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546416-02ca-4b41-a62e-b5074e3d04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.628684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546416-02ca-4b41-a62e-b5074e3d04f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.630634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7546416-02ca-4b41-a62e-b5074e3d04f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.638445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470bb1c-91fe-44c1-9ebd-4d0bcdd73c42 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.638625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7546416-02ca-4b41-a62e-b5074e3d04f9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.653023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91133b36-3b2e-4cb7-877f-a7b6ff006290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.656652 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91133b36-3b2e-4cb7-877f-a7b6ff006290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.656652 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91133b36-3b2e-4cb7-877f-a7b6ff006290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.656652 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91133b36-3b2e-4cb7-877f-a7b6ff006290 admin admin] PATH_INFO: `/v3/projects/4203caf671084060a2577b31c9a91513/users/5b750affb4cc4b2ba18ea5b7bf34aaa0/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.670730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1077/2136] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:37.672057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546416-02ca-4b41-a62e-b5074e3d04f9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.683853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546416-02ca-4b41-a62e-b5074e3d04f9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.690007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3eec3-c5cf-4020-9272-cdbd22bc40c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:37.691075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3eec3-c5cf-4020-9272-cdbd22bc40c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.691362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3eec3-c5cf-4020-9272-cdbd22bc40c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.692673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3eec3-c5cf-4020-9272-cdbd22bc40c1 admin admin] PATH_INFO: `/v3/projects/3508afcdab274332b2d4d4c62cc4faa1/users/73f22d5e41eb47858141881ba564c5ef/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.693598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91133b36-3b2e-4cb7-877f-a7b6ff006290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4203caf671084060a2577b31c9a91513, user_id=5b750affb4cc4b2ba18ea5b7bf34aaa0, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.696680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91133b36-3b2e-4cb7-877f-a7b6ff006290 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.727582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1060/2137] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:37 2022] PUT /identity/v3/projects/4203caf671084060a2577b31c9a91513/users/5b750affb4cc4b2ba18ea5b7bf34aaa0/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:37.731059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3eec3-c5cf-4020-9272-cdbd22bc40c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3508afcdab274332b2d4d4c62cc4faa1, user_id=73f22d5e41eb47858141881ba564c5ef, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:37.732218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91133b36-3b2e-4cb7-877f-a7b6ff006290 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:37.743635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3eec3-c5cf-4020-9272-cdbd22bc40c1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:37.767625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:37.770801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1078/2138] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:37 2022] PUT /identity/v3/projects/3508afcdab274332b2d4d4c62cc4faa1/users/73f22d5e41eb47858141881ba564c5ef/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:37.781714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324f84-a86e-4d1e-b094-9b7688669714 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:37.781915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324f84-a86e-4d1e-b094-9b7688669714 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:37.782319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324f84-a86e-4d1e-b094-9b7688669714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:37.825057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bc324f84-a86e-4d1e-b094-9b7688669714 None None] MFA Rules not processed for user `73f22d5e41eb47858141881ba564c5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:37.826242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bc324f84-a86e-4d1e-b094-9b7688669714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:37.918838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1079/2139] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:37.919151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91133b36-3b2e-4cb7-877f-a7b6ff006290 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:37.919811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc324f84-a86e-4d1e-b094-9b7688669714 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.007832 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7258c-7492-4617-80d0-6df9268d1532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.008540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7258c-7492-4617-80d0-6df9268d1532 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.009236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7258c-7492-4617-80d0-6df9268d1532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.009537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7258c-7492-4617-80d0-6df9268d1532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.010744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7258c-7492-4617-80d0-6df9268d1532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.012452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7258c-7492-4617-80d0-6df9268d1532 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.028110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc324f84-a86e-4d1e-b094-9b7688669714 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.036678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d183d-668b-4f34-aa7e-b18edc958c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.037084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1061/2140] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:38.037914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d183d-668b-4f34-aa7e-b18edc958c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.038386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d183d-668b-4f34-aa7e-b18edc958c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.038994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d183d-668b-4f34-aa7e-b18edc958c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.039912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d183d-668b-4f34-aa7e-b18edc958c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.040204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7258c-7492-4617-80d0-6df9268d1532 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.042481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d183d-668b-4f34-aa7e-b18edc958c4d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.057028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7258c-7492-4617-80d0-6df9268d1532 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.076578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39de97-cf0a-477d-8081-1cc3772c127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.076578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39de97-cf0a-477d-8081-1cc3772c127d admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.076578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39de97-cf0a-477d-8081-1cc3772c127d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.076578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39de97-cf0a-477d-8081-1cc3772c127d admin admin] PATH_INFO: `/v3/projects/4203caf671084060a2577b31c9a91513/users/5b750affb4cc4b2ba18ea5b7bf34aaa0/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.080925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39de97-cf0a-477d-8081-1cc3772c127d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4203caf671084060a2577b31c9a91513, user_id=5b750affb4cc4b2ba18ea5b7bf34aaa0, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.082583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:38.085191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39de97-cf0a-477d-8081-1cc3772c127d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.097983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1062/2141] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:38 2022] PUT /identity/v3/projects/4203caf671084060a2577b31c9a91513/users/5b750affb4cc4b2ba18ea5b7bf34aaa0/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:38.109115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bbb8-966d-432f-9d2c-2c12f1f2e4ca None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.109417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bbb8-966d-432f-9d2c-2c12f1f2e4ca None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.109704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bbb8-966d-432f-9d2c-2c12f1f2e4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.120135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1080/2142] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:37 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:38.121313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d183d-668b-4f34-aa7e-b18edc958c4d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.152454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5567bbb8-966d-432f-9d2c-2c12f1f2e4ca None None] MFA Rules not processed for user `5b750affb4cc4b2ba18ea5b7bf34aaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:38.154335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5567bbb8-966d-432f-9d2c-2c12f1f2e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.201137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d183d-668b-4f34-aa7e-b18edc958c4d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.207241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc615-2b83-4ce4-94cc-a4533f180bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.209209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc615-2b83-4ce4-94cc-a4533f180bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.209209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc615-2b83-4ce4-94cc-a4533f180bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.210482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc615-2b83-4ce4-94cc-a4533f180bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.211149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc615-2b83-4ce4-94cc-a4533f180bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.214075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc615-2b83-4ce4-94cc-a4533f180bd9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.252110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1081/2143] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:38 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:38.257616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc615-2b83-4ce4-94cc-a4533f180bd9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.264034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1063/2144] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:38.280347 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc615-2b83-4ce4-94cc-a4533f180bd9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.289823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3a9e-4e1e-4b4c-953e-3623b04e9a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.290854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3a9e-4e1e-4b4c-953e-3623b04e9a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.290854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3a9e-4e1e-4b4c-953e-3623b04e9a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.291144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3a9e-4e1e-4b4c-953e-3623b04e9a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.291965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f3a9e-4e1e-4b4c-953e-3623b04e9a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.295373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f3a9e-4e1e-4b4c-953e-3623b04e9a8f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.304680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567bbb8-966d-432f-9d2c-2c12f1f2e4ca None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.306598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5567bbb8-966d-432f-9d2c-2c12f1f2e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.315660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1082/2145] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:38.321129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3a9e-4e1e-4b4c-953e-3623b04e9a8f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.332816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3a9e-4e1e-4b4c-953e-3623b04e9a8f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.339201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0e205-d239-4151-ae27-4bc426b94396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.340324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0e205-d239-4151-ae27-4bc426b94396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.340782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0e205-d239-4151-ae27-4bc426b94396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.341288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0e205-d239-4151-ae27-4bc426b94396 admin admin] PATH_INFO: `/v3/projects/c6ac3dc58e4041a698a574b9630efe49/users/7854f4e14a07439b8f296bae1c9d5553/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.346041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:38.363172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0e205-d239-4151-ae27-4bc426b94396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ac3dc58e4041a698a574b9630efe49, user_id=7854f4e14a07439b8f296bae1c9d5553, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.366852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0e205-d239-4151-ae27-4bc426b94396 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.377185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567bbb8-966d-432f-9d2c-2c12f1f2e4ca None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.388879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1083/2146] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:38 2022] PUT /identity/v3/projects/c6ac3dc58e4041a698a574b9630efe49/users/7854f4e14a07439b8f296bae1c9d5553/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:38.390789 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0e205-d239-4151-ae27-4bc426b94396 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.437350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b9bd8-3e26-4d37-8ab1-6642b782f59c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.438008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b9bd8-3e26-4d37-8ab1-6642b782f59c service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.438678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b9bd8-3e26-4d37-8ab1-6642b782f59c service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.439762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b9bd8-3e26-4d37-8ab1-6642b782f59c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.476172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0e205-d239-4151-ae27-4bc426b94396 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.484212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db218553-eeab-4c4a-99ff-59c2586b672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.485139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218553-eeab-4c4a-99ff-59c2586b672a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.485825 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218553-eeab-4c4a-99ff-59c2586b672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.485825 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218553-eeab-4c4a-99ff-59c2586b672a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.486635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db218553-eeab-4c4a-99ff-59c2586b672a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.488532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db218553-eeab-4c4a-99ff-59c2586b672a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.501009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1084/2147] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:38.504936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db218553-eeab-4c4a-99ff-59c2586b672a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.527616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b9bd8-3e26-4d37-8ab1-6642b782f59c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.529044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db218553-eeab-4c4a-99ff-59c2586b672a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.530028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b9bd8-3e26-4d37-8ab1-6642b782f59c service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.535403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6d66c-6519-4abd-b615-ee5557a877a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.536384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d66c-6519-4abd-b615-ee5557a877a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.537204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d66c-6519-4abd-b615-ee5557a877a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.537542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6d66c-6519-4abd-b615-ee5557a877a9 admin admin] PATH_INFO: `/v3/projects/c6ac3dc58e4041a698a574b9630efe49/users/7854f4e14a07439b8f296bae1c9d5553/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.540498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6d66c-6519-4abd-b615-ee5557a877a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ac3dc58e4041a698a574b9630efe49, user_id=7854f4e14a07439b8f296bae1c9d5553, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.543794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6d66c-6519-4abd-b615-ee5557a877a9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.547361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1064/2148] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:38.560959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1085/2149] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:38 2022] PUT /identity/v3/projects/c6ac3dc58e4041a698a574b9630efe49/users/7854f4e14a07439b8f296bae1c9d5553/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:38.571513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4a53-3b29-4479-bd3d-d08f2e06d328 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.571841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4a53-3b29-4479-bd3d-d08f2e06d328 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.572127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4a53-3b29-4479-bd3d-d08f2e06d328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.607191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cd2b4a53-3b29-4479-bd3d-d08f2e06d328 None None] MFA Rules not processed for user `7854f4e14a07439b8f296bae1c9d5553`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:38.608491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cd2b4a53-3b29-4479-bd3d-d08f2e06d328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.663115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6d66c-6519-4abd-b615-ee5557a877a9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.712220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:38.720256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1065/2150] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:38.724278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b4a53-3b29-4479-bd3d-d08f2e06d328 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.726310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cd2b4a53-3b29-4479-bd3d-d08f2e06d328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:38.744620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6d66c-6519-4abd-b615-ee5557a877a9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.759327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93188f-9cb0-48b6-bd33-ac072267ee79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.760003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93188f-9cb0-48b6-bd33-ac072267ee79 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.760290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93188f-9cb0-48b6-bd33-ac072267ee79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.760579 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93188f-9cb0-48b6-bd33-ac072267ee79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.764018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:38.815712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b4a53-3b29-4479-bd3d-d08f2e06d328 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.821669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.822594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.822875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.823147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] PATH_INFO: `/v3/users/18ebfed707e3486e8d2ba522cef5ebbf` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.825194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ebfed707e3486e8d2ba522cef5ebbf)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.827135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.831846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93188f-9cb0-48b6-bd33-ac072267ee79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.833692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93188f-9cb0-48b6-bd33-ac072267ee79 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.845142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1086/2151] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:38.846173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93188f-9cb0-48b6-bd33-ac072267ee79 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:38.856875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93188f-9cb0-48b6-bd33-ac072267ee79 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:38.861705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefc5e2-68f2-44ef-9ef0-ea4369c09265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:38.862726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc5e2-68f2-44ef-9ef0-ea4369c09265 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:38.862726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc5e2-68f2-44ef-9ef0-ea4369c09265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:38.863125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc5e2-68f2-44ef-9ef0-ea4369c09265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:38.939731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ebfed707e3486e8d2ba522cef5ebbf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.940721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefc5e2-68f2-44ef-9ef0-ea4369c09265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:38.942637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefc5e2-68f2-44ef-9ef0-ea4369c09265 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:38.959815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1087/2152] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:38.961931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ebfed707e3486e8d2ba522cef5ebbf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.962862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ebfed707e3486e8d2ba522cef5ebbf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.972072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ebfed707e3486e8d2ba522cef5ebbf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:38.972724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33645cae-6888-4322-9047-19689b66d2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ebfed707e3486e8d2ba522cef5ebbf'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.023899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1066/2153] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:38 2022] DELETE /identity/v3/users/18ebfed707e3486e8d2ba522cef5ebbf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:39.280869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefc5e2-68f2-44ef-9ef0-ea4369c09265 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:39.326512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefc5e2-68f2-44ef-9ef0-ea4369c09265 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:39.503344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:39.505725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:39.506068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:39.506428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] PATH_INFO: `/v3/projects/2adee140c52d4f3989c70924948a17e1` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:39.508142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2adee140c52d4f3989c70924948a17e1)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:39.510794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:39.577479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:39.605020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2adee140c52d4f3989c70924948a17e1', 'request_id': 'req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.612127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2adee140c52d4f3989c70924948a17e1', 'request_id': 'req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.620139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2adee140c52d4f3989c70924948a17e1', 'request_id': 'req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.645889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] The token cache is being invalidate because project 2adee140c52d4f3989c70924948a17e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:39.648281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.650915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-56df1b8d-3dd9-416f-bcbd-32f3c95c3678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:39.658297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1088/2154] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:39 2022] DELETE /identity/v3/projects/2adee140c52d4f3989c70924948a17e1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:39.658570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182d0e-c247-4f74-8e45-843e02064e10 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:39.658570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182d0e-c247-4f74-8e45-843e02064e10 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:39.658869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182d0e-c247-4f74-8e45-843e02064e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:39.692442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-33182d0e-c247-4f74-8e45-843e02064e10 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:39.693924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-33182d0e-c247-4f74-8e45-843e02064e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:39.827408 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1067/2155] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:39.836249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890cf3-5a7b-4498-bf09-f13cabe2c94b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:39.836931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890cf3-5a7b-4498-bf09-f13cabe2c94b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:39.837303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890cf3-5a7b-4498-bf09-f13cabe2c94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:39.861459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c2890cf3-5a7b-4498-bf09-f13cabe2c94b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:39.863649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c2890cf3-5a7b-4498-bf09-f13cabe2c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:39.871926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1089/2156] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:39.876788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33182d0e-c247-4f74-8e45-843e02064e10 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:39.887105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33182d0e-c247-4f74-8e45-843e02064e10 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:39.893027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:39.893725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:39.894133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:39.894430 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:39.895311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:39.895625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:39.897899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:39.912989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1068/2157] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:39.916372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2890cf3-5a7b-4498-bf09-f13cabe2c94b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:39.938788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2890cf3-5a7b-4498-bf09-f13cabe2c94b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:39.948644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045b409-e37e-4a54-b4f0-5fac1433e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:39.949379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045b409-e37e-4a54-b4f0-5fac1433e6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:39.949666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045b409-e37e-4a54-b4f0-5fac1433e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:39.949948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045b409-e37e-4a54-b4f0-5fac1433e6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:39.950940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045b409-e37e-4a54-b4f0-5fac1433e6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:39.953013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045b409-e37e-4a54-b4f0-5fac1433e6d3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:39.982321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1090/2158] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:39 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:39.986590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:39.997418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd13b-1420-4215-ae30-7b52580eca1e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.023686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:40.057709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204654a1-d7ec-4378-8ecd-f6f8412ea84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.058393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204654a1-d7ec-4378-8ecd-f6f8412ea84d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.058685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204654a1-d7ec-4378-8ecd-f6f8412ea84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.058963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204654a1-d7ec-4378-8ecd-f6f8412ea84d admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.059666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204654a1-d7ec-4378-8ecd-f6f8412ea84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.061643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204654a1-d7ec-4378-8ecd-f6f8412ea84d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:40.084078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1069/2159] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:39 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:40.085786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045b409-e37e-4a54-b4f0-5fac1433e6d3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:40.097192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045b409-e37e-4a54-b4f0-5fac1433e6d3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.102803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f487c-2cd1-4669-aaf4-8c69c75e3a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.103473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f487c-2cd1-4669-aaf4-8c69c75e3a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.103760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f487c-2cd1-4669-aaf4-8c69c75e3a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.104040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f487c-2cd1-4669-aaf4-8c69c75e3a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.104771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f487c-2cd1-4669-aaf4-8c69c75e3a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.106437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f487c-2cd1-4669-aaf4-8c69c75e3a16 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:40.118839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1091/2160] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:40.122800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204654a1-d7ec-4378-8ecd-f6f8412ea84d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:40.133888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204654a1-d7ec-4378-8ecd-f6f8412ea84d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.139018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1ce39-8b0e-49ae-a6a6-f2d7487a9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.139690 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ce39-8b0e-49ae-a6a6-f2d7487a9d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.139977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ce39-8b0e-49ae-a6a6-f2d7487a9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.140258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1ce39-8b0e-49ae-a6a6-f2d7487a9d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.141031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1ce39-8b0e-49ae-a6a6-f2d7487a9d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.142660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1ce39-8b0e-49ae-a6a6-f2d7487a9d46 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:40.153858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1070/2161] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:40.158104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f487c-2cd1-4669-aaf4-8c69c75e3a16 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:40.169544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f487c-2cd1-4669-aaf4-8c69c75e3a16 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.174775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.175730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.176015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.176288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] PATH_INFO: `/v3/projects/d4b751ef3b044bfc9ab52e639f5e431a/users/5e9a958ca70b43c6b547fcb7def37d86/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.191379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b751ef3b044bfc9ab52e639f5e431a, user_id=5e9a958ca70b43c6b547fcb7def37d86, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.194223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:40.208013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1092/2162] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:40 2022] PUT /identity/v3/projects/d4b751ef3b044bfc9ab52e639f5e431a/users/5e9a958ca70b43c6b547fcb7def37d86/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:40.218685 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5109-a045-4d7d-bd04-ea5591c73b1b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.218976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5109-a045-4d7d-bd04-ea5591c73b1b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.219256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5109-a045-4d7d-bd04-ea5591c73b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.247274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-beca5109-a045-4d7d-bd04-ea5591c73b1b None None] MFA Rules not processed for user `5e9a958ca70b43c6b547fcb7def37d86`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:40.248802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-beca5109-a045-4d7d-bd04-ea5591c73b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:40.317341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1071/2163] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:40.329330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:40.331259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:40.390911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ebcee-43c2-4873-8ece-0a31995b7fa4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.395448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fb953-83da-4c03-a091-5d93b873c122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.396123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb953-83da-4c03-a091-5d93b873c122 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.396407 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb953-83da-4c03-a091-5d93b873c122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.397286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb953-83da-4c03-a091-5d93b873c122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.406905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fb953-83da-4c03-a091-5d93b873c122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.408368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fb953-83da-4c03-a091-5d93b873c122 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:40.417652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1093/2164] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:40.863168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca5109-a045-4d7d-bd04-ea5591c73b1b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:40.866135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-beca5109-a045-4d7d-bd04-ea5591c73b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:40.972149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca5109-a045-4d7d-bd04-ea5591c73b1b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:40.978988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:40.979955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:40.980310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:40.980663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] PATH_INFO: `/v3/users/4472f4a3149d4cd9807866c702b1dbb4` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:40.982016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4472f4a3149d4cd9807866c702b1dbb4)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:40.984222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:41.057331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:41.067538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4472f4a3149d4cd9807866c702b1dbb4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.091909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4472f4a3149d4cd9807866c702b1dbb4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.092866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4472f4a3149d4cd9807866c702b1dbb4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.101689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4472f4a3149d4cd9807866c702b1dbb4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.102365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4472f4a3149d4cd9807866c702b1dbb4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.115024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1072/2165] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:40 2022] DELETE /identity/v3/users/4472f4a3149d4cd9807866c702b1dbb4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:41.120173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117c64-a23f-4a99-9a76-27567feb877e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.120685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117c64-a23f-4a99-9a76-27567feb877e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.120770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117c64-a23f-4a99-9a76-27567feb877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.138403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b2117c64-a23f-4a99-9a76-27567feb877e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:41.139637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b2117c64-a23f-4a99-9a76-27567feb877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:41.190768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:41.204029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1094/2166] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:41.213619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:41.215028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:41.274611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b862a1c-af98-47a7-b2c9-71529e0cd1b4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:41.278233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d7ac-d2b3-40fb-8646-5e85bd3dac0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:41.278903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d7ac-d2b3-40fb-8646-5e85bd3dac0a service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.279184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d7ac-d2b3-40fb-8646-5e85bd3dac0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.279459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d7ac-d2b3-40fb-8646-5e85bd3dac0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.288253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d7ac-d2b3-40fb-8646-5e85bd3dac0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:41.289700 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d7ac-d2b3-40fb-8646-5e85bd3dac0a service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:41.299313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1073/2167] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:41.572560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2117c64-a23f-4a99-9a76-27567feb877e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:41.574067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b2117c64-a23f-4a99-9a76-27567feb877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:41.586165 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2117c64-a23f-4a99-9a76-27567feb877e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:41.591391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:41.592515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.592802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.593110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] PATH_INFO: `/v3/projects/099ce2c649f34476bf722ea964a90d5c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.594308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=099ce2c649f34476bf722ea964a90d5c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:41.596361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:41.647315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099ce2c649f34476bf722ea964a90d5c', 'request_id': 'req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.653769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099ce2c649f34476bf722ea964a90d5c', 'request_id': 'req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.660299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099ce2c649f34476bf722ea964a90d5c', 'request_id': 'req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.672393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] The token cache is being invalidate because project 099ce2c649f34476bf722ea964a90d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:41.672685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.673339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-43edb65a-d6dd-4e66-80dd-db844c1f1ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:41.674875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1095/2168] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:41 2022] DELETE /identity/v3/projects/099ce2c649f34476bf722ea964a90d5c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:41.680456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570701b-fed3-4006-87d3-8448d10094de None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.680855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570701b-fed3-4006-87d3-8448d10094de None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.681156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570701b-fed3-4006-87d3-8448d10094de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.700386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7570701b-fed3-4006-87d3-8448d10094de None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:41.701550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7570701b-fed3-4006-87d3-8448d10094de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:41.766507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1074/2169] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:41.775355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429eb68-f4a5-4f09-beb4-85398c24d347 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.775652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429eb68-f4a5-4f09-beb4-85398c24d347 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.775939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429eb68-f4a5-4f09-beb4-85398c24d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.796240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b429eb68-f4a5-4f09-beb4-85398c24d347 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:41.797490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b429eb68-f4a5-4f09-beb4-85398c24d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:41.806268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1096/2170] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:41.810705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570701b-fed3-4006-87d3-8448d10094de None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:41.821782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570701b-fed3-4006-87d3-8448d10094de None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:41.826439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:41.827148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.827507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.827813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.828740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:41.829140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:41.830999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:41.845638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1075/2171] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:41.850568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429eb68-f4a5-4f09-beb4-85398c24d347 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:41.860305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429eb68-f4a5-4f09-beb4-85398c24d347 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:41.866041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:41.866954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:41.867251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:41.867539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:41.868239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:41.870277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:41.904309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1097/2172] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:41 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:41.908419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:41.919743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724fe6-090b-4f36-9032-6960c3b4cfc4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:41.973314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:42.018068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd04d4-694e-4838-90cb-d7a2f5ad71e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.019408 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd04d4-694e-4838-90cb-d7a2f5ad71e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.019880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd04d4-694e-4838-90cb-d7a2f5ad71e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.020256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd04d4-694e-4838-90cb-d7a2f5ad71e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.021225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd04d4-694e-4838-90cb-d7a2f5ad71e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.024166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd04d4-694e-4838-90cb-d7a2f5ad71e4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.042529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.045026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.061247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1076/2173] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:41 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:42.062100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd04d4-694e-4838-90cb-d7a2f5ad71e4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.071469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff7531-06ed-4de7-b258-32cd42ee9aa2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.078809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd04d4-694e-4838-90cb-d7a2f5ad71e4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.081574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.083021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.083366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.083755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] PATH_INFO: `/v3/users/95c690fe7fcb421c87df18f952f38ff7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.086189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c690fe7fcb421c87df18f952f38ff7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.088882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244809-a3d2-42dd-8c37-26cb7d869920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.089945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244809-a3d2-42dd-8c37-26cb7d869920 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.090595 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244809-a3d2-42dd-8c37-26cb7d869920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.091104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244809-a3d2-42dd-8c37-26cb7d869920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.092391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c244809-a3d2-42dd-8c37-26cb7d869920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.095335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c244809-a3d2-42dd-8c37-26cb7d869920 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.101499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.114163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1077/2174] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:42.121819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244809-a3d2-42dd-8c37-26cb7d869920 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.144714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244809-a3d2-42dd-8c37-26cb7d869920 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.152745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.154487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.154831 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.155157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.155953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.158130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.196791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1078/2175] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:42.201341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.203387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.208120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c690fe7fcb421c87df18f952f38ff7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.226242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad952bd1-d5d3-4e3b-8d7c-c62042dcdaab admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.234095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c690fe7fcb421c87df18f952f38ff7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.238965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.239934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.240365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.240651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] PATH_INFO: `/v3/users/73f22d5e41eb47858141881ba564c5ef` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.250278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f22d5e41eb47858141881ba564c5ef)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.251320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c690fe7fcb421c87df18f952f38ff7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.252056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c690fe7fcb421c87df18f952f38ff7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.253123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c690fe7fcb421c87df18f952f38ff7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.253264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.276591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1098/2176] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:42 2022] DELETE /identity/v3/users/95c690fe7fcb421c87df18f952f38ff7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:42.276591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.276591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.318802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:42.330067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f22d5e41eb47858141881ba564c5ef'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.352686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f22d5e41eb47858141881ba564c5ef'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.354181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f22d5e41eb47858141881ba564c5ef'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.364664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f22d5e41eb47858141881ba564c5ef'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.365558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-854341da-b38d-4b59-b328-bec7c85bf407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f22d5e41eb47858141881ba564c5ef'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:42.370312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2cc44-3857-4221-88ed-5bb0825fb37e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.375152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66248bf-f7d9-4699-bcb2-9e162ba48182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.376737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66248bf-f7d9-4699-bcb2-9e162ba48182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.376737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66248bf-f7d9-4699-bcb2-9e162ba48182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.376737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66248bf-f7d9-4699-bcb2-9e162ba48182 admin admin] PATH_INFO: `/v3/projects/1c4696d3a0b7476aaece25e0a151d4f6/users/ea2de49e762a41e883f9787c4edcb9ba/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.395589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1079/2177] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:42 2022] DELETE /identity/v3/users/73f22d5e41eb47858141881ba564c5ef => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:42.397730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64dbf-34c2-4a32-b885-6cdbcf4578d5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.398064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64dbf-34c2-4a32-b885-6cdbcf4578d5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.398679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64dbf-34c2-4a32-b885-6cdbcf4578d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.402444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66248bf-f7d9-4699-bcb2-9e162ba48182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4696d3a0b7476aaece25e0a151d4f6, user_id=ea2de49e762a41e883f9787c4edcb9ba, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.405747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66248bf-f7d9-4699-bcb2-9e162ba48182 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.421881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b9f64dbf-34c2-4a32-b885-6cdbcf4578d5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:42.422661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1099/2178] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:42 2022] PUT /identity/v3/projects/1c4696d3a0b7476aaece25e0a151d4f6/users/ea2de49e762a41e883f9787c4edcb9ba/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:42.423969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966829fd-7657-4fda-a4d3-f268e153ae10 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.424260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966829fd-7657-4fda-a4d3-f268e153ae10 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.424552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966829fd-7657-4fda-a4d3-f268e153ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.426105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b9f64dbf-34c2-4a32-b885-6cdbcf4578d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.454575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-966829fd-7657-4fda-a4d3-f268e153ae10 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:42.455877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-966829fd-7657-4fda-a4d3-f268e153ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.504572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1080/2179] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:42.506693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea032f-4871-4532-8d88-59235e8ce742 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.506988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea032f-4871-4532-8d88-59235e8ce742 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.507267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea032f-4871-4532-8d88-59235e8ce742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.522759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1100/2180] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:42.522759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966829fd-7657-4fda-a4d3-f268e153ae10 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.522759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-966829fd-7657-4fda-a4d3-f268e153ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.534868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-57ea032f-4871-4532-8d88-59235e8ce742 None None] MFA Rules not processed for user `ea2de49e762a41e883f9787c4edcb9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:42.536055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-57ea032f-4871-4532-8d88-59235e8ce742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.548539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:42.583404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966829fd-7657-4fda-a4d3-f268e153ae10 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.587972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.588623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.588947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.589233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.599763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.601258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.603003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1081/2181] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:42.603833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea032f-4871-4532-8d88-59235e8ce742 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.611798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1101/2182] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:42.613240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea032f-4871-4532-8d88-59235e8ce742 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.615078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.616412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:42.617224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.617873 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.618159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.618437 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.627927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.629407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.640888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1082/2183] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:42.672045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:42.676289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab011219-7c76-4c4f-b152-1e1c46e037f3 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:42.682622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:42.683429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:42.683870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:42.684440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:42.694954 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:42.697226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:42.707814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1102/2184] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:42.997053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:42.999317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:43.045306 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbf55-f685-44e4-91e0-1ed8069560a4 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.056114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:43.058250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:43.058799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.061315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.061916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.061916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] PATH_INFO: `/v3/projects/2bf495139a114aabb8364daf183019fa` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.064727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf495139a114aabb8364daf183019fa)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.067647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.081918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4548550-385b-4986-81ab-aff86bf2c6e4 service glance] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.090182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.091376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.091871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.092508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] PATH_INFO: `/v3/projects/3508afcdab274332b2d4d4c62cc4faa1` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.094211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3508afcdab274332b2d4d4c62cc4faa1)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.097180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.135962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf495139a114aabb8364daf183019fa', 'request_id': 'req-2d0e1aea-0119-4984-8283-cfb6227e538c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.144392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf495139a114aabb8364daf183019fa', 'request_id': 'req-2d0e1aea-0119-4984-8283-cfb6227e538c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.152335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf495139a114aabb8364daf183019fa', 'request_id': 'req-2d0e1aea-0119-4984-8283-cfb6227e538c'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.164624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3508afcdab274332b2d4d4c62cc4faa1', 'request_id': 'req-f2121df1-add8-4667-ad64-6fd0cfdff13f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.169196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] The token cache is being invalidate because project 2bf495139a114aabb8364daf183019fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:43.169487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.170204 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.171765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1083/2185] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:42 2022] DELETE /identity/v3/projects/2bf495139a114aabb8364daf183019fa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:43.172429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3508afcdab274332b2d4d4c62cc4faa1', 'request_id': 'req-f2121df1-add8-4667-ad64-6fd0cfdff13f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.175678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:43.177689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:43.182321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3508afcdab274332b2d4d4c62cc4faa1', 'request_id': 'req-f2121df1-add8-4667-ad64-6fd0cfdff13f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.198247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] The token cache is being invalidate because project 3508afcdab274332b2d4d4c62cc4faa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:43.198541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.199202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.200863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1103/2186] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:43 2022] DELETE /identity/v3/projects/3508afcdab274332b2d4d4c62cc4faa1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:43.210498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:43.213436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:43.281779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e1aea-0119-4984-8283-cfb6227e538c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.333494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2121df1-add8-4667-ad64-6fd0cfdff13f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:43.344733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.346914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.347207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.348520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] PATH_INFO: `/v3/users/7854f4e14a07439b8f296bae1c9d5553` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.353136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7854f4e14a07439b8f296bae1c9d5553)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.354203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:43.356350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.393581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:43.395051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:43.395344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:43.395721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] PATH_INFO: `/v3/users/5b750affb4cc4b2ba18ea5b7bf34aaa0` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:43.397023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b750affb4cc4b2ba18ea5b7bf34aaa0)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:43.399435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:43.441859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7854f4e14a07439b8f296bae1c9d5553'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.471105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7854f4e14a07439b8f296bae1c9d5553'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.479471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b750affb4cc4b2ba18ea5b7bf34aaa0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.483334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7854f4e14a07439b8f296bae1c9d5553'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.484394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7854f4e14a07439b8f296bae1c9d5553'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.485352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7854f4e14a07439b8f296bae1c9d5553'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.495214 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:43.503657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b750affb4cc4b2ba18ea5b7bf34aaa0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.505269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b750affb4cc4b2ba18ea5b7bf34aaa0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.513351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1104/2187] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:43 2022] DELETE /identity/v3/users/7854f4e14a07439b8f296bae1c9d5553 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:43.524383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b750affb4cc4b2ba18ea5b7bf34aaa0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.525047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b750affb4cc4b2ba18ea5b7bf34aaa0'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:43.546545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1084/2188] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:43 2022] DELETE /identity/v3/users/5b750affb4cc4b2ba18ea5b7bf34aaa0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:44.038247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.039842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.098529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.100266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.128414 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bd7d3-64cf-4c1a-aa5c-140bc85feef0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.184366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c216c-15f0-4e54-bd93-2193c3f4599d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.189572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.190447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.190733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.191156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] PATH_INFO: `/v3/projects/4203caf671084060a2577b31c9a91513` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.192350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4203caf671084060a2577b31c9a91513)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.192466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.193990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.194290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.194569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] PATH_INFO: `/v3/projects/c6ac3dc58e4041a698a574b9630efe49` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.194993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.195873 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ac3dc58e4041a698a574b9630efe49)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.198753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.244758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4203caf671084060a2577b31c9a91513', 'request_id': 'req-63b0115b-3991-471c-a5eb-c589d996c7ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.248434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ac3dc58e4041a698a574b9630efe49', 'request_id': 'req-3a4a4b2a-6440-4323-ae12-d1b65a994b63'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.251374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4203caf671084060a2577b31c9a91513', 'request_id': 'req-63b0115b-3991-471c-a5eb-c589d996c7ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.252979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:44.253856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ac3dc58e4041a698a574b9630efe49', 'request_id': 'req-3a4a4b2a-6440-4323-ae12-d1b65a994b63'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.260386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4203caf671084060a2577b31c9a91513', 'request_id': 'req-63b0115b-3991-471c-a5eb-c589d996c7ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.261626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ac3dc58e4041a698a574b9630efe49', 'request_id': 'req-3a4a4b2a-6440-4323-ae12-d1b65a994b63'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.275748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] The token cache is being invalidate because project 4203caf671084060a2577b31c9a91513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:44.276008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.276637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-63b0115b-3991-471c-a5eb-c589d996c7ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.277246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] The token cache is being invalidate because project c6ac3dc58e4041a698a574b9630efe49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:44.277534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.278159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3a4a4b2a-6440-4323-ae12-d1b65a994b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:44.278279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1085/2189] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:44 2022] DELETE /identity/v3/projects/4203caf671084060a2577b31c9a91513 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:44.280073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1105/2190] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:44 2022] DELETE /identity/v3/projects/c6ac3dc58e4041a698a574b9630efe49 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:44.284456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a357e8-e79a-462d-b5b7-ddd8c1787d59 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.284629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ff6c-ac46-4659-942b-bdc47e8da6cb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.284750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a357e8-e79a-462d-b5b7-ddd8c1787d59 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.284895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ff6c-ac46-4659-942b-bdc47e8da6cb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.285120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a357e8-e79a-462d-b5b7-ddd8c1787d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.285237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ff6c-ac46-4659-942b-bdc47e8da6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.305727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-76a357e8-e79a-462d-b5b7-ddd8c1787d59 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:44.305918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ed58ff6c-ac46-4659-942b-bdc47e8da6cb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:44.306934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-76a357e8-e79a-462d-b5b7-ddd8c1787d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.307124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ed58ff6c-ac46-4659-942b-bdc47e8da6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.336109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:44.371122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1086/2191] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:44.374339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1106/2192] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:44.382251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803eed-69f3-4c78-8882-80c2b94a0149 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.382755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803eed-69f3-4c78-8882-80c2b94a0149 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.383262 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f803eed-69f3-4c78-8882-80c2b94a0149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.385325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7517cb-7592-470a-8042-b2dfcca95eb0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.385624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7517cb-7592-470a-8042-b2dfcca95eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.385910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7517cb-7592-470a-8042-b2dfcca95eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.403431 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0f803eed-69f3-4c78-8882-80c2b94a0149 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:44.404507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0c7517cb-7592-470a-8042-b2dfcca95eb0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:44.404886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0f803eed-69f3-4c78-8882-80c2b94a0149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.405713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0c7517cb-7592-470a-8042-b2dfcca95eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.413116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1087/2193] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:44.413564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1107/2194] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:44.417068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f803eed-69f3-4c78-8882-80c2b94a0149 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.417445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7517cb-7592-470a-8042-b2dfcca95eb0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.426991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7517cb-7592-470a-8042-b2dfcca95eb0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.427110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f803eed-69f3-4c78-8882-80c2b94a0149 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.432325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.432489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.433005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.433133 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.433291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.433417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.433571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.433697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.434304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:44.434420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:44.434615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.434730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.436252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.436375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.448585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1088/2195] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:44.452172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1108/2196] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:37:44.453171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.453367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.463360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d9325-cd4b-4b8b-b8a4-f979706c7ebd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.463896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68a944-1b00-436a-a083-8d5c0e1852c2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.468297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e873fe-992c-4b96-93e9-ff5b0944569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.468857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162b1d-2198-4c6b-85e1-bcca75d3ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.468991 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e873fe-992c-4b96-93e9-ff5b0944569b admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.469247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e873fe-992c-4b96-93e9-ff5b0944569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.469533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e873fe-992c-4b96-93e9-ff5b0944569b admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.469673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162b1d-2198-4c6b-85e1-bcca75d3ca23 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.469872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162b1d-2198-4c6b-85e1-bcca75d3ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.470155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162b1d-2198-4c6b-85e1-bcca75d3ca23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.470302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e873fe-992c-4b96-93e9-ff5b0944569b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.470827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0162b1d-2198-4c6b-85e1-bcca75d3ca23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.472126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e873fe-992c-4b96-93e9-ff5b0944569b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.472730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0162b1d-2198-4c6b-85e1-bcca75d3ca23 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.502267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1089/2197] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:44.506905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e873fe-992c-4b96-93e9-ff5b0944569b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.510733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1109/2198] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:44.512330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162b1d-2198-4c6b-85e1-bcca75d3ca23 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.583670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e873fe-992c-4b96-93e9-ff5b0944569b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.583897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162b1d-2198-4c6b-85e1-bcca75d3ca23 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.589326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2376d-9b26-459f-8eca-b9e1cc5fd8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.589462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b0aa5-c8fa-4655-afea-4bd72fec5e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.589748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2376d-9b26-459f-8eca-b9e1cc5fd8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.589851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b0aa5-c8fa-4655-afea-4bd72fec5e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.590036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2376d-9b26-459f-8eca-b9e1cc5fd8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.590159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b0aa5-c8fa-4655-afea-4bd72fec5e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.590322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2376d-9b26-459f-8eca-b9e1cc5fd8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.590426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b0aa5-c8fa-4655-afea-4bd72fec5e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.591009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2376d-9b26-459f-8eca-b9e1cc5fd8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.591120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b0aa5-c8fa-4655-afea-4bd72fec5e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.593525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b0aa5-c8fa-4655-afea-4bd72fec5e51 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.593930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2376d-9b26-459f-8eca-b9e1cc5fd8f6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.616884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1110/2199] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:44.620258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1090/2200] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:44.620915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2376d-9b26-459f-8eca-b9e1cc5fd8f6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.624040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b0aa5-c8fa-4655-afea-4bd72fec5e51 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.631562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2376d-9b26-459f-8eca-b9e1cc5fd8f6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.634299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b0aa5-c8fa-4655-afea-4bd72fec5e51 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.637945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055a46-bd5f-4421-aa8a-ea8948309b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.638670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055a46-bd5f-4421-aa8a-ea8948309b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.638911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055a46-bd5f-4421-aa8a-ea8948309b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.639192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055a46-bd5f-4421-aa8a-ea8948309b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.639922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bbc55-2130-4f04-a8e5-0cfdd8280fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.640053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3055a46-bd5f-4421-aa8a-ea8948309b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.640613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bbc55-2130-4f04-a8e5-0cfdd8280fca admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.640911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bbc55-2130-4f04-a8e5-0cfdd8280fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.641581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bbc55-2130-4f04-a8e5-0cfdd8280fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.641785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3055a46-bd5f-4421-aa8a-ea8948309b9b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.641947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bbc55-2130-4f04-a8e5-0cfdd8280fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.643546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bbc55-2130-4f04-a8e5-0cfdd8280fca admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.655638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1111/2201] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:44.659588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1091/2202] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:44.659761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055a46-bd5f-4421-aa8a-ea8948309b9b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.661837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bbc55-2130-4f04-a8e5-0cfdd8280fca admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.672582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bbc55-2130-4f04-a8e5-0cfdd8280fca admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.674879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055a46-bd5f-4421-aa8a-ea8948309b9b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.679314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712faf99-2efc-4b41-803e-d250b9a4d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.680316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712faf99-2efc-4b41-803e-d250b9a4d2da admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.680480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e421a-37f9-4ec3-a1f7-8df2f7ce307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.680691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712faf99-2efc-4b41-803e-d250b9a4d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.681079 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712faf99-2efc-4b41-803e-d250b9a4d2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.681192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e421a-37f9-4ec3-a1f7-8df2f7ce307e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.681480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e421a-37f9-4ec3-a1f7-8df2f7ce307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.681644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e421a-37f9-4ec3-a1f7-8df2f7ce307e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.681926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712faf99-2efc-4b41-803e-d250b9a4d2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.682402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e421a-37f9-4ec3-a1f7-8df2f7ce307e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.683723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712faf99-2efc-4b41-803e-d250b9a4d2da admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.684168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e421a-37f9-4ec3-a1f7-8df2f7ce307e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.696965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1092/2203] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:44.697551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1112/2204] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:44.701408 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712faf99-2efc-4b41-803e-d250b9a4d2da admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.701523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e421a-37f9-4ec3-a1f7-8df2f7ce307e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.712886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e421a-37f9-4ec3-a1f7-8df2f7ce307e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.715337 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712faf99-2efc-4b41-803e-d250b9a4d2da admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.718259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e964-7e91-48f6-af8f-ff8744ac7fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.719191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e964-7e91-48f6-af8f-ff8744ac7fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.719469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e964-7e91-48f6-af8f-ff8744ac7fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.719745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e964-7e91-48f6-af8f-ff8744ac7fc4 admin admin] PATH_INFO: `/v3/projects/d2c13f8824db4efea211e4b3a143ec0b/users/d3a21291e1c04cdbaf1cb2cb1e7bf2ab/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.721218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda5df6-72c0-4259-b2cc-0d22c70c9df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.722258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda5df6-72c0-4259-b2cc-0d22c70c9df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.722554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda5df6-72c0-4259-b2cc-0d22c70c9df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.722832 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda5df6-72c0-4259-b2cc-0d22c70c9df3 admin admin] PATH_INFO: `/v3/projects/92b6f8419b7347ffb6f27061843a6a57/users/ff77145517514f3680da7f08020b518f/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.727987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:44.740486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e964-7e91-48f6-af8f-ff8744ac7fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c13f8824db4efea211e4b3a143ec0b, user_id=d3a21291e1c04cdbaf1cb2cb1e7bf2ab, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.741110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda5df6-72c0-4259-b2cc-0d22c70c9df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b6f8419b7347ffb6f27061843a6a57, user_id=ff77145517514f3680da7f08020b518f, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.743140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e964-7e91-48f6-af8f-ff8744ac7fc4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.743581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda5df6-72c0-4259-b2cc-0d22c70c9df3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:44.759696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1093/2205] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:44 2022] PUT /identity/v3/projects/92b6f8419b7347ffb6f27061843a6a57/users/ff77145517514f3680da7f08020b518f/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:44.759996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1113/2206] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:44 2022] PUT /identity/v3/projects/d2c13f8824db4efea211e4b3a143ec0b/users/d3a21291e1c04cdbaf1cb2cb1e7bf2ab/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:44.771219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fd59a-5698-4d5a-8692-36d4129ea6f8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.771418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe33bfd-6959-4fe3-970e-3b3c99cf4996 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.772344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fd59a-5698-4d5a-8692-36d4129ea6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.772456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe33bfd-6959-4fe3-970e-3b3c99cf4996 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.772558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fd59a-5698-4d5a-8692-36d4129ea6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.772634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe33bfd-6959-4fe3-970e-3b3c99cf4996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.801174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dfe33bfd-6959-4fe3-970e-3b3c99cf4996 None None] MFA Rules not processed for user `ff77145517514f3680da7f08020b518f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:44.802436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dfe33bfd-6959-4fe3-970e-3b3c99cf4996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.808031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bb2fd59a-5698-4d5a-8692-36d4129ea6f8 None None] MFA Rules not processed for user `d3a21291e1c04cdbaf1cb2cb1e7bf2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:44.809441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bb2fd59a-5698-4d5a-8692-36d4129ea6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.824048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:44.887975 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1094/2208] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:44.888213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1114/2208] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:44.901051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fd59a-5698-4d5a-8692-36d4129ea6f8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.901269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe33bfd-6959-4fe3-970e-3b3c99cf4996 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:44.902942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dfe33bfd-6959-4fe3-970e-3b3c99cf4996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:44.984811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe33bfd-6959-4fe3-970e-3b3c99cf4996 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.989141 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fd59a-5698-4d5a-8692-36d4129ea6f8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:44.989309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a56b-4f26-409d-9704-3de4a9d37616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.989931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a56b-4f26-409d-9704-3de4a9d37616 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.990321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a56b-4f26-409d-9704-3de4a9d37616 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.990660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a56b-4f26-409d-9704-3de4a9d37616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.994084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b02aff-b328-4873-96ee-190eb7d00f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:44.994835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02aff-b328-4873-96ee-190eb7d00f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:44.995124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02aff-b328-4873-96ee-190eb7d00f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:44.995408 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02aff-b328-4873-96ee-190eb7d00f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:44.996356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b02aff-b328-4873-96ee-190eb7d00f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:44.998511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b02aff-b328-4873-96ee-190eb7d00f8a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.010789 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74a56b-4f26-409d-9704-3de4a9d37616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.013286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74a56b-4f26-409d-9704-3de4a9d37616 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.037760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1095/2209] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:44 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:45.038591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1115/2210] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:45.041772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b02aff-b328-4873-96ee-190eb7d00f8a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:45.134853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b02aff-b328-4873-96ee-190eb7d00f8a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:45.141039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecc808-4cf7-47bb-bd1a-653dfe1af8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:45.141699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecc808-4cf7-47bb-bd1a-653dfe1af8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.141984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecc808-4cf7-47bb-bd1a-653dfe1af8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.142267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecc808-4cf7-47bb-bd1a-653dfe1af8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.142976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecc808-4cf7-47bb-bd1a-653dfe1af8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.145388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecc808-4cf7-47bb-bd1a-653dfe1af8e0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.153452 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:45.190310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1096/2211] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:45 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:45.198810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a56b-4f26-409d-9704-3de4a9d37616 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:45.216278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a56b-4f26-409d-9704-3de4a9d37616 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:45.224604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2970c2-a876-4496-95f5-28319a9dcd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:45.225707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2970c2-a876-4496-95f5-28319a9dcd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.230112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2970c2-a876-4496-95f5-28319a9dcd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.230817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2970c2-a876-4496-95f5-28319a9dcd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.231889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2970c2-a876-4496-95f5-28319a9dcd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.234702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2970c2-a876-4496-95f5-28319a9dcd32 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.248312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1116/2212] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:45.252620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecc808-4cf7-47bb-bd1a-653dfe1af8e0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:45.266559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecc808-4cf7-47bb-bd1a-653dfe1af8e0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:45.282526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db141a9-a6e5-4566-9fc1-d39f35541baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:45.283652 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db141a9-a6e5-4566-9fc1-d39f35541baa admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.284474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db141a9-a6e5-4566-9fc1-d39f35541baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.284586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db141a9-a6e5-4566-9fc1-d39f35541baa admin admin] PATH_INFO: `/v3/projects/511fb8cfb8d143c58e3cb8828e92cdd5/users/14499da1638441b2bf89077603379ba6/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.312847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db141a9-a6e5-4566-9fc1-d39f35541baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=511fb8cfb8d143c58e3cb8828e92cdd5, user_id=14499da1638441b2bf89077603379ba6, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.315940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db141a9-a6e5-4566-9fc1-d39f35541baa admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.339073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1097/2213] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:45 2022] PUT /identity/v3/projects/511fb8cfb8d143c58e3cb8828e92cdd5/users/14499da1638441b2bf89077603379ba6/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:45.343194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2970c2-a876-4496-95f5-28319a9dcd32 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:45.356634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2970c2-a876-4496-95f5-28319a9dcd32 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:45.453075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85661853-26d7-4d3f-9761-8a7186eb2f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:45.454164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85661853-26d7-4d3f-9761-8a7186eb2f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.454657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85661853-26d7-4d3f-9761-8a7186eb2f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.455144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85661853-26d7-4d3f-9761-8a7186eb2f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.456112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85661853-26d7-4d3f-9761-8a7186eb2f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.458458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85661853-26d7-4d3f-9761-8a7186eb2f66 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.472437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1117/2214] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:45.476703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db141a9-a6e5-4566-9fc1-d39f35541baa admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:45.493628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db141a9-a6e5-4566-9fc1-d39f35541baa admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:45.499838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290e1f0-e471-4c94-b6ef-26d0d211531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:45.501409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290e1f0-e471-4c94-b6ef-26d0d211531c admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.501926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290e1f0-e471-4c94-b6ef-26d0d211531c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.502439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290e1f0-e471-4c94-b6ef-26d0d211531c admin admin] PATH_INFO: `/v3/projects/511fb8cfb8d143c58e3cb8828e92cdd5/users/14499da1638441b2bf89077603379ba6/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.506519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290e1f0-e471-4c94-b6ef-26d0d211531c admin admin] RBAC: Authorizing `identity:create_grant(project_id=511fb8cfb8d143c58e3cb8828e92cdd5, user_id=14499da1638441b2bf89077603379ba6, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.513750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290e1f0-e471-4c94-b6ef-26d0d211531c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.537641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1098/2215] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:45 2022] PUT /identity/v3/projects/511fb8cfb8d143c58e3cb8828e92cdd5/users/14499da1638441b2bf89077603379ba6/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:45.547952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92445-65ac-4f68-a06a-b672b8ca9257 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.548246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92445-65ac-4f68-a06a-b672b8ca9257 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.548528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92445-65ac-4f68-a06a-b672b8ca9257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.579621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6fb92445-65ac-4f68-a06a-b672b8ca9257 None None] MFA Rules not processed for user `14499da1638441b2bf89077603379ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:45.580875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6fb92445-65ac-4f68-a06a-b672b8ca9257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:45.622569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:45.650007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1118/2216] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:45.660960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290e1f0-e471-4c94-b6ef-26d0d211531c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:45.718516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290e1f0-e471-4c94-b6ef-26d0d211531c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:45.722255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186edb0d-5a40-43a2-a313-f97c30561f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:45.723007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186edb0d-5a40-43a2-a313-f97c30561f5f service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.723287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186edb0d-5a40-43a2-a313-f97c30561f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.723620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186edb0d-5a40-43a2-a313-f97c30561f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.733161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186edb0d-5a40-43a2-a313-f97c30561f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.734576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186edb0d-5a40-43a2-a313-f97c30561f5f service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.744578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1099/2217] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:45.817268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb92445-65ac-4f68-a06a-b672b8ca9257 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:45.827488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb92445-65ac-4f68-a06a-b672b8ca9257 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:45.835917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f40564-3791-4078-b197-72d704a7bd05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:45.836574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40564-3791-4078-b197-72d704a7bd05 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:45.836987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40564-3791-4078-b197-72d704a7bd05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:45.837174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40564-3791-4078-b197-72d704a7bd05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:45.894884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f40564-3791-4078-b197-72d704a7bd05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:45.896267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f40564-3791-4078-b197-72d704a7bd05 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:45.905757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1119/2218] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:46.187316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186edb0d-5a40-43a2-a313-f97c30561f5f service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:46.279155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186edb0d-5a40-43a2-a313-f97c30561f5f service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:46.283928 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:46.284966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:46.285248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:46.285524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] PATH_INFO: `/v3/users/ff77145517514f3680da7f08020b518f` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:46.286716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff77145517514f3680da7f08020b518f)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:46.289219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:46.377364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff77145517514f3680da7f08020b518f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.386962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:46.399362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff77145517514f3680da7f08020b518f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.400531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff77145517514f3680da7f08020b518f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.410316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff77145517514f3680da7f08020b518f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.411622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff77145517514f3680da7f08020b518f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:46.431376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1100/2219] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:46 2022] DELETE /identity/v3/users/ff77145517514f3680da7f08020b518f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:46.437303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4505ecc-378e-465c-932c-50b9035ef583 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:46.437798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4505ecc-378e-465c-932c-50b9035ef583 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:46.437898 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4505ecc-378e-465c-932c-50b9035ef583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:46.462408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d4505ecc-378e-465c-932c-50b9035ef583 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:46.463662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d4505ecc-378e-465c-932c-50b9035ef583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:46.571034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1120/2220] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:46.586925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:46.588869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:46.684888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851c4a-f31b-42a3-b920-8ea8a4bf5d0c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:46.693777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936846a-9acd-4d3f-8fcb-87b41a47b6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:46.694931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936846a-9acd-4d3f-8fcb-87b41a47b6fb service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:46.695053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936846a-9acd-4d3f-8fcb-87b41a47b6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:46.695292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936846a-9acd-4d3f-8fcb-87b41a47b6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:46.710149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936846a-9acd-4d3f-8fcb-87b41a47b6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:46.713282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936846a-9acd-4d3f-8fcb-87b41a47b6fb service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:46.745318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1101/2221] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:47.170620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4505ecc-378e-465c-932c-50b9035ef583 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:47.172305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d4505ecc-378e-465c-932c-50b9035ef583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:47.190618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4505ecc-378e-465c-932c-50b9035ef583 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:47.203988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:47.204981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:47.205274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:47.205688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] PATH_INFO: `/v3/projects/92b6f8419b7347ffb6f27061843a6a57` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:47.207015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b6f8419b7347ffb6f27061843a6a57)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:47.209721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:47.261521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b6f8419b7347ffb6f27061843a6a57', 'request_id': 'req-96fb3451-2ffe-4478-9082-9f9e7e5d9168'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.267831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b6f8419b7347ffb6f27061843a6a57', 'request_id': 'req-96fb3451-2ffe-4478-9082-9f9e7e5d9168'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.274876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b6f8419b7347ffb6f27061843a6a57', 'request_id': 'req-96fb3451-2ffe-4478-9082-9f9e7e5d9168'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.284023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:47.289501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] The token cache is being invalidate because project 92b6f8419b7347ffb6f27061843a6a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:47.290065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.291303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.293733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1121/2222] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:47 2022] DELETE /identity/v3/projects/92b6f8419b7347ffb6f27061843a6a57 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:47.298201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936846a-9acd-4d3f-8fcb-87b41a47b6fb service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:47.309388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936846a-9acd-4d3f-8fcb-87b41a47b6fb service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:47.369724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:47.370807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:47.371090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:47.371364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] PATH_INFO: `/v3/users/14499da1638441b2bf89077603379ba6` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:47.372592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14499da1638441b2bf89077603379ba6)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:47.374591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:47.427292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14499da1638441b2bf89077603379ba6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.440414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14499da1638441b2bf89077603379ba6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.441127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14499da1638441b2bf89077603379ba6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.456169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14499da1638441b2bf89077603379ba6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.457162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-013c3eb7-420e-4258-aa6a-4c8aa3364848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14499da1638441b2bf89077603379ba6'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:47.463513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:47.475471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1102/2223] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:47 2022] DELETE /identity/v3/users/14499da1638441b2bf89077603379ba6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:47.941211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:47.943322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:47.964311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3451-2ffe-4478-9082-9f9e7e5d9168 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.022992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.023887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.024170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.024448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] PATH_INFO: `/v3/projects/511fb8cfb8d143c58e3cb8828e92cdd5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.025677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=511fb8cfb8d143c58e3cb8828e92cdd5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.027592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.079953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511fb8cfb8d143c58e3cb8828e92cdd5', 'request_id': 'req-23012d2a-03dc-477d-86d8-f617a3b80cbe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.086019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511fb8cfb8d143c58e3cb8828e92cdd5', 'request_id': 'req-23012d2a-03dc-477d-86d8-f617a3b80cbe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.092711 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511fb8cfb8d143c58e3cb8828e92cdd5', 'request_id': 'req-23012d2a-03dc-477d-86d8-f617a3b80cbe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.107569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] The token cache is being invalidate because project 511fb8cfb8d143c58e3cb8828e92cdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:48.107860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.108484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23012d2a-03dc-477d-86d8-f617a3b80cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.110109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1122/2224] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:47 2022] DELETE /identity/v3/projects/511fb8cfb8d143c58e3cb8828e92cdd5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:48.115228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2a905-afe5-4db6-998f-b1a44682144a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.115800 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2a905-afe5-4db6-998f-b1a44682144a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.116155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2a905-afe5-4db6-998f-b1a44682144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.134576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2dc2a905-afe5-4db6-998f-b1a44682144a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:48.135859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2dc2a905-afe5-4db6-998f-b1a44682144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.213099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1103/2225] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:48.222494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77caf3-2288-48cf-86e2-32e7de96806d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.223201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77caf3-2288-48cf-86e2-32e7de96806d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.223527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77caf3-2288-48cf-86e2-32e7de96806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.244157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4b77caf3-2288-48cf-86e2-32e7de96806d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:48.245404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b77caf3-2288-48cf-86e2-32e7de96806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.253732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1123/2226] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:48.257984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2a905-afe5-4db6-998f-b1a44682144a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.267694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2a905-afe5-4db6-998f-b1a44682144a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.272701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.273469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.273844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.274276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.275004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:48.275313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.277005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.289273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1104/2227] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:48.293523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77caf3-2288-48cf-86e2-32e7de96806d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.303020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77caf3-2288-48cf-86e2-32e7de96806d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.307766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.308421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.308709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.309020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.309797 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.311713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.337539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1124/2228] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:48.341762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.352472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288811-0d84-46c3-8f1d-53d4190a4440 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.399635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.401396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.409330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b3093-9393-4617-94bf-27b8a1ecc3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.410006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3093-9393-4617-94bf-27b8a1ecc3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.410422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3093-9393-4617-94bf-27b8a1ecc3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.410707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3093-9393-4617-94bf-27b8a1ecc3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.411394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b3093-9393-4617-94bf-27b8a1ecc3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.413977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b3093-9393-4617-94bf-27b8a1ecc3e1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.437255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1105/2229] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:48.441279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b3093-9393-4617-94bf-27b8a1ecc3e1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.450760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b3093-9393-4617-94bf-27b8a1ecc3e1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.455407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c07b7-e041-4a72-985f-950c4b2fcc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.456055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c07b7-e041-4a72-985f-950c4b2fcc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.456335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c07b7-e041-4a72-985f-950c4b2fcc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.456858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c07b7-e041-4a72-985f-950c4b2fcc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.457360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c07b7-e041-4a72-985f-950c4b2fcc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.459495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c07b7-e041-4a72-985f-950c4b2fcc91 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.469612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1966fb7-f9a3-4222-9eb5-8f8b5e7cddf4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.471467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1106/2230] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:48.476681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c07b7-e041-4a72-985f-950c4b2fcc91 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.477681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.478566 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.478840 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.479147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] PATH_INFO: `/v3/users/d3a21291e1c04cdbaf1cb2cb1e7bf2ab` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.480355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a21291e1c04cdbaf1cb2cb1e7bf2ab)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.482344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.484316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:48.487138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c07b7-e041-4a72-985f-950c4b2fcc91 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.492588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35172e3-30d3-439e-bc68-71b42b2f437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.493278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35172e3-30d3-439e-bc68-71b42b2f437a admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.493564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35172e3-30d3-439e-bc68-71b42b2f437a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.493842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35172e3-30d3-439e-bc68-71b42b2f437a admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.495948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35172e3-30d3-439e-bc68-71b42b2f437a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.496637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35172e3-30d3-439e-bc68-71b42b2f437a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.507331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1107/2231] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:48.511568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35172e3-30d3-439e-bc68-71b42b2f437a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.523885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35172e3-30d3-439e-bc68-71b42b2f437a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.529464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac55a-43a1-4a8a-9896-727992db180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.530466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac55a-43a1-4a8a-9896-727992db180b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.530843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac55a-43a1-4a8a-9896-727992db180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.531184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac55a-43a1-4a8a-9896-727992db180b admin admin] PATH_INFO: `/v3/projects/9c0fd38243c24a2d9cffc8400ff176b9/users/015bdfa1facc48a8896dd5651a20a4ec/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.539360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a21291e1c04cdbaf1cb2cb1e7bf2ab'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.546801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ac55a-43a1-4a8a-9896-727992db180b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0fd38243c24a2d9cffc8400ff176b9, user_id=015bdfa1facc48a8896dd5651a20a4ec, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.551234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ac55a-43a1-4a8a-9896-727992db180b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.554865 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a21291e1c04cdbaf1cb2cb1e7bf2ab'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.566158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a21291e1c04cdbaf1cb2cb1e7bf2ab'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.566158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a21291e1c04cdbaf1cb2cb1e7bf2ab'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.568935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9c805415-1e32-496f-8869-1dc40545a8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a21291e1c04cdbaf1cb2cb1e7bf2ab'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:48.569468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1108/2232] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:48 2022] PUT /identity/v3/projects/9c0fd38243c24a2d9cffc8400ff176b9/users/015bdfa1facc48a8896dd5651a20a4ec/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:48.580674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf09bd-e568-49f5-853f-86b1d13fe95c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.581024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf09bd-e568-49f5-853f-86b1d13fe95c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.581395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf09bd-e568-49f5-853f-86b1d13fe95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.587200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1125/2233] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:48 2022] DELETE /identity/v3/users/d3a21291e1c04cdbaf1cb2cb1e7bf2ab => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:48.591890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc66d-9e0a-4d28-b9bb-a550b265c68e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.592581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc66d-9e0a-4d28-b9bb-a550b265c68e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.594292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc66d-9e0a-4d28-b9bb-a550b265c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.617283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4adf09bd-e568-49f5-853f-86b1d13fe95c None None] MFA Rules not processed for user `015bdfa1facc48a8896dd5651a20a4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:48.618739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4adf09bd-e568-49f5-853f-86b1d13fe95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.623106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-585cc66d-9e0a-4d28-b9bb-a550b265c68e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:48.627266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-585cc66d-9e0a-4d28-b9bb-a550b265c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.636669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:48.707241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1126/2234] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:48.714946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1109/2235] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:48.718562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cc66d-9e0a-4d28-b9bb-a550b265c68e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.719504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf09bd-e568-49f5-853f-86b1d13fe95c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.719657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-585cc66d-9e0a-4d28-b9bb-a550b265c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.720999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4adf09bd-e568-49f5-853f-86b1d13fe95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:48.735216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf09bd-e568-49f5-853f-86b1d13fe95c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.739867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3ac9-a8ee-4f1a-82dc-ea683b8740f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.740561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3ac9-a8ee-4f1a-82dc-ea683b8740f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.740868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3ac9-a8ee-4f1a-82dc-ea683b8740f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.741149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3ac9-a8ee-4f1a-82dc-ea683b8740f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.741846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e3ac9-a8ee-4f1a-82dc-ea683b8740f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.743754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e3ac9-a8ee-4f1a-82dc-ea683b8740f3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.781677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1110/2236] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:48.782039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cc66d-9e0a-4d28-b9bb-a550b265c68e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.783189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3ac9-a8ee-4f1a-82dc-ea683b8740f3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.821587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:48.846150 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf521e-24d2-4551-8f64-5027ea7ec616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.847373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf521e-24d2-4551-8f64-5027ea7ec616 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.847795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf521e-24d2-4551-8f64-5027ea7ec616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.848131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf521e-24d2-4551-8f64-5027ea7ec616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.892061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3ac9-a8ee-4f1a-82dc-ea683b8740f3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.898006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb805f17-2100-4909-bb22-61b315c13b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.898764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb805f17-2100-4909-bb22-61b315c13b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.899120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb805f17-2100-4909-bb22-61b315c13b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.899475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb805f17-2100-4909-bb22-61b315c13b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.900611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb805f17-2100-4909-bb22-61b315c13b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.903450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb805f17-2100-4909-bb22-61b315c13b0c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.930418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1111/2237] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:48 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:48.933974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb805f17-2100-4909-bb22-61b315c13b0c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.936757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf521e-24d2-4551-8f64-5027ea7ec616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.938932 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf521e-24d2-4551-8f64-5027ea7ec616 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.948746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb805f17-2100-4909-bb22-61b315c13b0c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.953075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1127/2238] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:48.955555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e955d6-6af8-48ed-a3b3-7cf0411844a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.956859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e955d6-6af8-48ed-a3b3-7cf0411844a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.957138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e955d6-6af8-48ed-a3b3-7cf0411844a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.957715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e955d6-6af8-48ed-a3b3-7cf0411844a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:48.958539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e955d6-6af8-48ed-a3b3-7cf0411844a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:48.960903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e955d6-6af8-48ed-a3b3-7cf0411844a7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:48.976386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1112/2239] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:48.978009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf521e-24d2-4551-8f64-5027ea7ec616 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:48.988163 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf521e-24d2-4551-8f64-5027ea7ec616 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:48.996640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373ba0-187f-47e8-9c38-d1d9022bfb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:48.997662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373ba0-187f-47e8-9c38-d1d9022bfb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:48.997949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373ba0-187f-47e8-9c38-d1d9022bfb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:48.998317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373ba0-187f-47e8-9c38-d1d9022bfb4f admin admin] PATH_INFO: `/v3/projects/f80758a443b34d828cdc20a3bf4ae027/users/01da9f17498f405bb1571254315e3520/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.018654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1373ba0-187f-47e8-9c38-d1d9022bfb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80758a443b34d828cdc20a3bf4ae027, user_id=01da9f17498f405bb1571254315e3520, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.021806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1373ba0-187f-47e8-9c38-d1d9022bfb4f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.035868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1128/2240] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:48 2022] PUT /identity/v3/projects/f80758a443b34d828cdc20a3bf4ae027/users/01da9f17498f405bb1571254315e3520/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:49.039956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e955d6-6af8-48ed-a3b3-7cf0411844a7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.050960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e955d6-6af8-48ed-a3b3-7cf0411844a7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.138737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dc5f7-268b-44f5-9d9a-e96a4b12c80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.139478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dc5f7-268b-44f5-9d9a-e96a4b12c80f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.139773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dc5f7-268b-44f5-9d9a-e96a4b12c80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.140030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dc5f7-268b-44f5-9d9a-e96a4b12c80f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.140748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dc5f7-268b-44f5-9d9a-e96a4b12c80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.142384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dc5f7-268b-44f5-9d9a-e96a4b12c80f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.156304 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1113/2241] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:49.158435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373ba0-187f-47e8-9c38-d1d9022bfb4f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.170171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373ba0-187f-47e8-9c38-d1d9022bfb4f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.175130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.176090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.176438 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.176780 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] PATH_INFO: `/v3/projects/f80758a443b34d828cdc20a3bf4ae027/users/01da9f17498f405bb1571254315e3520/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.179007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80758a443b34d828cdc20a3bf4ae027, user_id=01da9f17498f405bb1571254315e3520, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.181883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.196937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1129/2242] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:49 2022] PUT /identity/v3/projects/f80758a443b34d828cdc20a3bf4ae027/users/01da9f17498f405bb1571254315e3520/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:49.206914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115dc9-954d-47c0-9618-1598dadc616b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.207211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115dc9-954d-47c0-9618-1598dadc616b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.207496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115dc9-954d-47c0-9618-1598dadc616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.228269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:49.238187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f5115dc9-954d-47c0-9618-1598dadc616b None None] MFA Rules not processed for user `01da9f17498f405bb1571254315e3520`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:49.239963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f5115dc9-954d-47c0-9618-1598dadc616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.339432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.341396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.353242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1114/2243] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:49.365862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115dc9-954d-47c0-9618-1598dadc616b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.367388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f5115dc9-954d-47c0-9618-1598dadc616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.438838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115dc9-954d-47c0-9618-1598dadc616b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.442736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf4fea-a207-480e-8c0e-00ddf0845ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.444033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4fea-a207-480e-8c0e-00ddf0845ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.444333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4fea-a207-480e-8c0e-00ddf0845ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.444585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4fea-a207-480e-8c0e-00ddf0845ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.450183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edb366-bce2-4fe3-86f1-4846e49cf698 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.465124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.466096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.466591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.467598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] PATH_INFO: `/v3/projects/d2c13f8824db4efea211e4b3a143ec0b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.469030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c13f8824db4efea211e4b3a143ec0b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.472029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.514783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf4fea-a207-480e-8c0e-00ddf0845ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.516638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf4fea-a207-480e-8c0e-00ddf0845ac5 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.527178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1115/2244] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:49.530792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c13f8824db4efea211e4b3a143ec0b', 'request_id': 'req-241ff324-2c24-4fc7-91a6-449dcabfde6b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.532134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:49.537929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c13f8824db4efea211e4b3a143ec0b', 'request_id': 'req-241ff324-2c24-4fc7-91a6-449dcabfde6b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.544578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c13f8824db4efea211e4b3a143ec0b', 'request_id': 'req-241ff324-2c24-4fc7-91a6-449dcabfde6b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.558988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] The token cache is being invalidate because project d2c13f8824db4efea211e4b3a143ec0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:49.559279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.559921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-241ff324-2c24-4fc7-91a6-449dcabfde6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.561499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1130/2245] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:49 2022] DELETE /identity/v3/projects/d2c13f8824db4efea211e4b3a143ec0b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:49.566388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd516b-b889-438a-bfa4-8efe0237044d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.569251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd516b-b889-438a-bfa4-8efe0237044d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.569548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd516b-b889-438a-bfa4-8efe0237044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.587913 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0dbd516b-b889-438a-bfa4-8efe0237044d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:49.589241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0dbd516b-b889-438a-bfa4-8efe0237044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.638779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:49.658284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1116/2246] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:49.667009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47bf7d-5d64-402f-b3ac-cd8bfe19e91b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.667309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47bf7d-5d64-402f-b3ac-cd8bfe19e91b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.667581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47bf7d-5d64-402f-b3ac-cd8bfe19e91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.688255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1b47bf7d-5d64-402f-b3ac-cd8bfe19e91b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:49.689548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b47bf7d-5d64-402f-b3ac-cd8bfe19e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.700430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1131/2247] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:49.708628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd516b-b889-438a-bfa4-8efe0237044d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.720858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd516b-b889-438a-bfa4-8efe0237044d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.734168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.734852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.735366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.735650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.736408 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:49.736765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.740741 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.753872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47bf7d-5d64-402f-b3ac-cd8bfe19e91b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.755576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b47bf7d-5d64-402f-b3ac-cd8bfe19e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.757320 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1117/2248] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:49.761519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.769896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47bf7d-5d64-402f-b3ac-cd8bfe19e91b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.774350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b052-1587-4dfa-9f02-ad7f85b845e9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.774876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.775751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.776036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.776317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] PATH_INFO: `/v3/users/5e9a958ca70b43c6b547fcb7def37d86` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.777544 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9a958ca70b43c6b547fcb7def37d86)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.780173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.780556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2a95-c3e6-4bf4-beb2-7918fd1b144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.781316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2a95-c3e6-4bf4-beb2-7918fd1b144e admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.781674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2a95-c3e6-4bf4-beb2-7918fd1b144e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.781970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2a95-c3e6-4bf4-beb2-7918fd1b144e admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.782731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2a95-c3e6-4bf4-beb2-7918fd1b144e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.784718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2a95-c3e6-4bf4-beb2-7918fd1b144e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:49.820977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1118/2249] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:49.821879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2a95-c3e6-4bf4-beb2-7918fd1b144e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:49.844651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9a958ca70b43c6b547fcb7def37d86'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.859191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9a958ca70b43c6b547fcb7def37d86'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.879552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9a958ca70b43c6b547fcb7def37d86'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.881964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9a958ca70b43c6b547fcb7def37d86'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.883090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-94eb3ad5-2893-4b14-aed0-a58de6750300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9a958ca70b43c6b547fcb7def37d86'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:49.898597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1132/2250] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:49 2022] DELETE /identity/v3/users/5e9a958ca70b43c6b547fcb7def37d86 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:49.903002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095402-243f-433b-9838-728c77be6014 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.903650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095402-243f-433b-9838-728c77be6014 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.904118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095402-243f-433b-9838-728c77be6014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.910967 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2a95-c3e6-4bf4-beb2-7918fd1b144e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:49.934541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f0095402-243f-433b-9838-728c77be6014 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:49.935939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f0095402-243f-433b-9838-728c77be6014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:49.980525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:49.981346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:49.981726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:49.982011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:49.982772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:49.984911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.001152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1133/2251] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:50.008879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1119/2252] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:49 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:50.010728 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0095402-243f-433b-9838-728c77be6014 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.010883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.012215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f0095402-243f-433b-9838-728c77be6014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.012449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.024900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0095402-243f-433b-9838-728c77be6014 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.030363 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538063bc-948b-46f4-b01e-978f966840d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.031066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538063bc-948b-46f4-b01e-978f966840d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.031351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538063bc-948b-46f4-b01e-978f966840d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.031643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538063bc-948b-46f4-b01e-978f966840d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.032366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538063bc-948b-46f4-b01e-978f966840d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.034025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538063bc-948b-46f4-b01e-978f966840d1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.044726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1134/2253] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:50.048512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538063bc-948b-46f4-b01e-978f966840d1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.058701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538063bc-948b-46f4-b01e-978f966840d1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.063346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f4d46-09d1-4370-a043-ef69e3c801bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.063990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4d46-09d1-4370-a043-ef69e3c801bf admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.064274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4d46-09d1-4370-a043-ef69e3c801bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.064665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4d46-09d1-4370-a043-ef69e3c801bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.065419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4d46-09d1-4370-a043-ef69e3c801bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.067010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4d46-09d1-4370-a043-ef69e3c801bf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.074206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134feda-d3f6-4b56-998d-2c9d7df6ad68 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.080394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1135/2254] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:50.080534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1e07-6411-49c2-a930-b6a13f10a2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.080534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1e07-6411-49c2-a930-b6a13f10a2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.080534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1e07-6411-49c2-a930-b6a13f10a2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.080534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1e07-6411-49c2-a930-b6a13f10a2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.081394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f4d46-09d1-4370-a043-ef69e3c801bf admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.085709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:50.091483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f4d46-09d1-4370-a043-ef69e3c801bf admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.092549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e1e07-6411-49c2-a930-b6a13f10a2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.094619 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e1e07-6411-49c2-a930-b6a13f10a2a0 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.097535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697b137-daa4-4eb8-820d-448f3fdb04a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.098547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697b137-daa4-4eb8-820d-448f3fdb04a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.098828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697b137-daa4-4eb8-820d-448f3fdb04a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.099113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697b137-daa4-4eb8-820d-448f3fdb04a9 admin admin] PATH_INFO: `/v3/projects/9a7fa516f0cc48729376c8fa123328fa/users/fa969d4ab43e4858b077f8f55e9be8b8/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.107997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1120/2255] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:37:50.117618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697b137-daa4-4eb8-820d-448f3fdb04a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7fa516f0cc48729376c8fa123328fa, user_id=fa969d4ab43e4858b077f8f55e9be8b8, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.120348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697b137-daa4-4eb8-820d-448f3fdb04a9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.133059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:50.140817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1136/2256] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:50 2022] PUT /identity/v3/projects/9a7fa516f0cc48729376c8fa123328fa/users/fa969d4ab43e4858b077f8f55e9be8b8/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:50.150852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f112bd-fffb-4a85-8df5-cdd71887c32c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.151151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f112bd-fffb-4a85-8df5-cdd71887c32c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.151425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f112bd-fffb-4a85-8df5-cdd71887c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.183385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-44f112bd-fffb-4a85-8df5-cdd71887c32c None None] MFA Rules not processed for user `fa969d4ab43e4858b077f8f55e9be8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:50.184777 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-44f112bd-fffb-4a85-8df5-cdd71887c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.262637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1121/2257] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:50.267152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697b137-daa4-4eb8-820d-448f3fdb04a9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.348897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697b137-daa4-4eb8-820d-448f3fdb04a9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.363575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.365491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.366053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.366578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.378905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.378905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.413200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1137/2258] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:50 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:50.417267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f112bd-fffb-4a85-8df5-cdd71887c32c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.430209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f112bd-fffb-4a85-8df5-cdd71887c32c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.455919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.458441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.530322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17480ae-eddb-4d78-b572-aa5d968ab09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.531015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17480ae-eddb-4d78-b572-aa5d968ab09f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.532565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17480ae-eddb-4d78-b572-aa5d968ab09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.532807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17480ae-eddb-4d78-b572-aa5d968ab09f admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.533543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17480ae-eddb-4d78-b572-aa5d968ab09f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.537650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17480ae-eddb-4d78-b572-aa5d968ab09f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.560643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1122/2259] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:50 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:50.567667 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17480ae-eddb-4d78-b572-aa5d968ab09f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.574931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a79ad-5963-4dcf-92d1-7621a23d7e37 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.582030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17480ae-eddb-4d78-b572-aa5d968ab09f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.584929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.586836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.587217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.587532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] PATH_INFO: `/v3/projects/d4b751ef3b044bfc9ab52e639f5e431a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.589099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2d2d5-36e8-44cb-bf5b-663d573bbac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.589643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b751ef3b044bfc9ab52e639f5e431a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.589981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2d2d5-36e8-44cb-bf5b-663d573bbac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.590327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2d2d5-36e8-44cb-bf5b-663d573bbac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.590672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2d2d5-36e8-44cb-bf5b-663d573bbac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.591540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2d2d5-36e8-44cb-bf5b-663d573bbac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.593541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2d2d5-36e8-44cb-bf5b-663d573bbac4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.595144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.606422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1123/2260] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:50.610940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2d2d5-36e8-44cb-bf5b-663d573bbac4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.622610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2d2d5-36e8-44cb-bf5b-663d573bbac4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.629518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900bb28-b41c-4cff-821f-bd8613ff212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.630290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900bb28-b41c-4cff-821f-bd8613ff212f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.630515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900bb28-b41c-4cff-821f-bd8613ff212f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.630833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900bb28-b41c-4cff-821f-bd8613ff212f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.631607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900bb28-b41c-4cff-821f-bd8613ff212f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.633271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900bb28-b41c-4cff-821f-bd8613ff212f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.647530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1124/2261] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:50.652388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900bb28-b41c-4cff-821f-bd8613ff212f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.673660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b751ef3b044bfc9ab52e639f5e431a', 'request_id': 'req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.674277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900bb28-b41c-4cff-821f-bd8613ff212f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.683200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b751ef3b044bfc9ab52e639f5e431a', 'request_id': 'req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.693699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b751ef3b044bfc9ab52e639f5e431a', 'request_id': 'req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.715972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] The token cache is being invalidate because project d4b751ef3b044bfc9ab52e639f5e431a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:50.716339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.717648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.719480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1138/2262] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:50 2022] DELETE /identity/v3/projects/d4b751ef3b044bfc9ab52e639f5e431a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:50.720447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:50.725412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.748769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:50.752346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:50.765929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc714b-773d-4bfe-91ac-a664c0319495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.767856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc714b-773d-4bfe-91ac-a664c0319495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.768272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc714b-773d-4bfe-91ac-a664c0319495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.768965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc714b-773d-4bfe-91ac-a664c0319495 admin admin] PATH_INFO: `/v3/projects/6576e0bc6f0b4bec8fd3642f2209cfba/users/055c488c151d4e66b9b154f1f091ab96/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.794182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc714b-773d-4bfe-91ac-a664c0319495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6576e0bc6f0b4bec8fd3642f2209cfba, user_id=055c488c151d4e66b9b154f1f091ab96, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.797710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc714b-773d-4bfe-91ac-a664c0319495 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.828584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1125/2263] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:50 2022] PUT /identity/v3/projects/6576e0bc6f0b4bec8fd3642f2209cfba/users/055c488c151d4e66b9b154f1f091ab96/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:50.837869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3fb94-462f-4077-96d7-0c49cf2146db None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.837869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3fb94-462f-4077-96d7-0c49cf2146db None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.837869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3fb94-462f-4077-96d7-0c49cf2146db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.851864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0a16d-207a-4ef4-ba8b-24f4e9dae63d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:50.854284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-2ab3fb94-462f-4077-96d7-0c49cf2146db None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:50.855628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2ab3fb94-462f-4077-96d7-0c49cf2146db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.909337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:50.910216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.910521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.910782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] PATH_INFO: `/v3/users/8c2e24af7c07437db4a8b33d34190a0f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.912048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2e24af7c07437db4a8b33d34190a0f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:50.914032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:50.917372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1126/2264] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:50.918555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162c1f-510a-4086-a510-c7e8a15b2d1b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:50.918842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162c1f-510a-4086-a510-c7e8a15b2d1b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:50.919119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162c1f-510a-4086-a510-c7e8a15b2d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:50.948459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d1162c1f-510a-4086-a510-c7e8a15b2d1b None None] MFA Rules not processed for user `055c488c151d4e66b9b154f1f091ab96`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:50.949866 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d1162c1f-510a-4086-a510-c7e8a15b2d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:50.986831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2e24af7c07437db4a8b33d34190a0f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.991257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2e24af7c07437db4a8b33d34190a0f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:50.999671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2e24af7c07437db4a8b33d34190a0f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.000432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2e24af7c07437db4a8b33d34190a0f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.001310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d22c022a-7611-4d9e-9a9e-c7794ca35266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2e24af7c07437db4a8b33d34190a0f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.015166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1139/2265] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:50 2022] DELETE /identity/v3/users/8c2e24af7c07437db4a8b33d34190a0f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:51.016439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09e92-bf3d-4202-9b47-39f3baf7e187 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.016697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09e92-bf3d-4202-9b47-39f3baf7e187 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.017016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09e92-bf3d-4202-9b47-39f3baf7e187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.041023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-afa09e92-bf3d-4202-9b47-39f3baf7e187 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:51.042496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-afa09e92-bf3d-4202-9b47-39f3baf7e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.053172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1127/2266] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:51.053172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c208b22-e4ce-448b-9136-c66eb6f68c9e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.053172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c208b22-e4ce-448b-9136-c66eb6f68c9e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.053172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c208b22-e4ce-448b-9136-c66eb6f68c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.071793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0c208b22-e4ce-448b-9136-c66eb6f68c9e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:51.073405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0c208b22-e4ce-448b-9136-c66eb6f68c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.088993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:51.118291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1140/2267] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:51.119114 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09e92-bf3d-4202-9b47-39f3baf7e187 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.120424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-afa09e92-bf3d-4202-9b47-39f3baf7e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.132857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09e92-bf3d-4202-9b47-39f3baf7e187 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.138044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.138886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.139172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.139533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.140125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.142137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.147220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1128/2268] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:51.150863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c208b22-e4ce-448b-9136-c66eb6f68c9e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.159590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:51.165448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c208b22-e4ce-448b-9136-c66eb6f68c9e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.173325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.174345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.174811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.175326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.179540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1141/2269] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:51.179686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:51.179792 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.179886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.179971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.180067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.195390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1129/2270] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:51.196405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.207433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee13b5-68da-4481-a61a-120f24d54ead admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.251687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8b14-76c2-4326-bf6f-54eff353ef28 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.255726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf726b-54ee-4bb7-9aa9-72e8e591411b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.257676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf726b-54ee-4bb7-9aa9-72e8e591411b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.257973 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf726b-54ee-4bb7-9aa9-72e8e591411b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.258378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf726b-54ee-4bb7-9aa9-72e8e591411b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.278373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112045d-0b2b-43a2-9866-535ecf0bdb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.279268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112045d-0b2b-43a2-9866-535ecf0bdb86 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.279622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112045d-0b2b-43a2-9866-535ecf0bdb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.279879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112045d-0b2b-43a2-9866-535ecf0bdb86 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.280687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112045d-0b2b-43a2-9866-535ecf0bdb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.282654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112045d-0b2b-43a2-9866-535ecf0bdb86 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.319818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1130/2271] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:51.319818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112045d-0b2b-43a2-9866-535ecf0bdb86 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.333121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112045d-0b2b-43a2-9866-535ecf0bdb86 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.338332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737ec60-3587-4f23-9686-738ec13bf163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.338988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737ec60-3587-4f23-9686-738ec13bf163 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.339266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737ec60-3587-4f23-9686-738ec13bf163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.339544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737ec60-3587-4f23-9686-738ec13bf163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.340307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737ec60-3587-4f23-9686-738ec13bf163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.342535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737ec60-3587-4f23-9686-738ec13bf163 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.345318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf726b-54ee-4bb7-9aa9-72e8e591411b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.347041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf726b-54ee-4bb7-9aa9-72e8e591411b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.359547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1142/2272] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:51.360981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf726b-54ee-4bb7-9aa9-72e8e591411b service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.374034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf726b-54ee-4bb7-9aa9-72e8e591411b service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.375235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1131/2273] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:51.379492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737ec60-3587-4f23-9686-738ec13bf163 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.461038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf5a3-3298-4c9a-8142-c42c52438977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.461727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf5a3-3298-4c9a-8142-c42c52438977 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.462010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf5a3-3298-4c9a-8142-c42c52438977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.462478 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf5a3-3298-4c9a-8142-c42c52438977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.462994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf5a3-3298-4c9a-8142-c42c52438977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.464653 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf5a3-3298-4c9a-8142-c42c52438977 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.479129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737ec60-3587-4f23-9686-738ec13bf163 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.479687 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1143/2274] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:51.480615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf5a3-3298-4c9a-8142-c42c52438977 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.484617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2186-c654-4af6-8a6f-ebe0c616377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.485378 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2186-c654-4af6-8a6f-ebe0c616377a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.486106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2186-c654-4af6-8a6f-ebe0c616377a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.486435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2186-c654-4af6-8a6f-ebe0c616377a admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.487296 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba2186-c654-4af6-8a6f-ebe0c616377a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.489539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba2186-c654-4af6-8a6f-ebe0c616377a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.497197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:51.502636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf5a3-3298-4c9a-8142-c42c52438977 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.514001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641e273-c877-434f-bd39-f78a5270d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.515514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e273-c877-434f-bd39-f78a5270d3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.515904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e273-c877-434f-bd39-f78a5270d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.516489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e273-c877-434f-bd39-f78a5270d3cd admin admin] PATH_INFO: `/v3/projects/8a174716d6754b9dba20c076296b6c2e/users/dde406d042fe49e4994a140a28d5a4d8/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.522203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1132/2275] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:51.527077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2186-c654-4af6-8a6f-ebe0c616377a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.540530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641e273-c877-434f-bd39-f78a5270d3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a174716d6754b9dba20c076296b6c2e, user_id=dde406d042fe49e4994a140a28d5a4d8, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.541594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2186-c654-4af6-8a6f-ebe0c616377a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.544350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641e273-c877-434f-bd39-f78a5270d3cd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.547857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1617-14b3-446d-9ebc-5fcb054132ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.548537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1617-14b3-446d-9ebc-5fcb054132ef admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.548941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1617-14b3-446d-9ebc-5fcb054132ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.549119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1617-14b3-446d-9ebc-5fcb054132ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.549882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d1617-14b3-446d-9ebc-5fcb054132ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.551451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d1617-14b3-446d-9ebc-5fcb054132ef admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.565290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1133/2276] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:51.566955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1144/2277] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:51 2022] PUT /identity/v3/projects/8a174716d6754b9dba20c076296b6c2e/users/dde406d042fe49e4994a140a28d5a4d8/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:51.570784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641e273-c877-434f-bd39-f78a5270d3cd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.571369 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1617-14b3-446d-9ebc-5fcb054132ef admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.583625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1617-14b3-446d-9ebc-5fcb054132ef admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.642764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:51.668917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641e273-c877-434f-bd39-f78a5270d3cd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.672937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b6c77-dfd9-4be6-a892-469db7c50060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.673615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6c77-dfd9-4be6-a892-469db7c50060 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.673895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6c77-dfd9-4be6-a892-469db7c50060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.674224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6c77-dfd9-4be6-a892-469db7c50060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.674962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b6c77-dfd9-4be6-a892-469db7c50060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.675800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fcbd2-9ab6-47b3-a093-76b4934026a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.676549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b6c77-dfd9-4be6-a892-469db7c50060 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.677253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fcbd2-9ab6-47b3-a093-76b4934026a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.678170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fcbd2-9ab6-47b3-a093-76b4934026a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.678827 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fcbd2-9ab6-47b3-a093-76b4934026a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.679637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fcbd2-9ab6-47b3-a093-76b4934026a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.681465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fcbd2-9ab6-47b3-a093-76b4934026a1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.689436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1134/2278] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:51.692651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b6c77-dfd9-4be6-a892-469db7c50060 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.695550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1145/2279] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:51.699574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fcbd2-9ab6-47b3-a093-76b4934026a1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.703769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b6c77-dfd9-4be6-a892-469db7c50060 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.708591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d694a-ea0c-431c-bf8e-ccbbc82eb3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.709633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d694a-ea0c-431c-bf8e-ccbbc82eb3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.709984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d694a-ea0c-431c-bf8e-ccbbc82eb3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.710087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fcbd2-9ab6-47b3-a093-76b4934026a1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.710383 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d694a-ea0c-431c-bf8e-ccbbc82eb3e7 admin admin] PATH_INFO: `/v3/projects/6e5f1fba40b345e9931e4ffc48e4ffe0/users/8751e209cc9341b1a29cd861739503f1/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.715074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.716220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.716220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.716497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] PATH_INFO: `/v3/projects/8a174716d6754b9dba20c076296b6c2e/users/dde406d042fe49e4994a140a28d5a4d8/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.719151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a174716d6754b9dba20c076296b6c2e, user_id=dde406d042fe49e4994a140a28d5a4d8, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.721943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.727852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d694a-ea0c-431c-bf8e-ccbbc82eb3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5f1fba40b345e9931e4ffc48e4ffe0, user_id=8751e209cc9341b1a29cd861739503f1, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.730646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d694a-ea0c-431c-bf8e-ccbbc82eb3e7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.733288 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1146/2280] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:51 2022] PUT /identity/v3/projects/8a174716d6754b9dba20c076296b6c2e/users/dde406d042fe49e4994a140a28d5a4d8/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:51.746401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:51.749999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.759327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1135/2281] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:51 2022] PUT /identity/v3/projects/6e5f1fba40b345e9931e4ffc48e4ffe0/users/8751e209cc9341b1a29cd861739503f1/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:51.759327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ebd11-224e-4df8-8399-b69bfd67404d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.759327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ebd11-224e-4df8-8399-b69bfd67404d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.759327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ebd11-224e-4df8-8399-b69bfd67404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.796242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c09ebd11-224e-4df8-8399-b69bfd67404d None None] MFA Rules not processed for user `dde406d042fe49e4994a140a28d5a4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:51.797598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c09ebd11-224e-4df8-8399-b69bfd67404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.840883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4462e-4bea-4ad5-8291-52698cd19455 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:51.900391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1136/2282] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:51.900391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38b9e-82c6-44de-8d9c-c180660db2ce None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.900391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38b9e-82c6-44de-8d9c-c180660db2ce None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.900391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38b9e-82c6-44de-8d9c-c180660db2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.931891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:51.932760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:51.933074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:51.933344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] PATH_INFO: `/v3/projects/3cfdd3078cce48ec9b297f2741945d3d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:51.934417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f7b38b9e-82c6-44de-8d9c-c180660db2ce None None] MFA Rules not processed for user `8751e209cc9341b1a29cd861739503f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:51.934546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfdd3078cce48ec9b297f2741945d3d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:51.935779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f7b38b9e-82c6-44de-8d9c-c180660db2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:51.936429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:51.949109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:51.987948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfdd3078cce48ec9b297f2741945d3d', 'request_id': 'req-d2243e36-0225-4262-af95-8b20187a131f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:51.994130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfdd3078cce48ec9b297f2741945d3d', 'request_id': 'req-d2243e36-0225-4262-af95-8b20187a131f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:52.000745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfdd3078cce48ec9b297f2741945d3d', 'request_id': 'req-d2243e36-0225-4262-af95-8b20187a131f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:52.005119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1137/2283] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:52.006292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b38b9e-82c6-44de-8d9c-c180660db2ce None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.007785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f7b38b9e-82c6-44de-8d9c-c180660db2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.014302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] The token cache is being invalidate because project 3cfdd3078cce48ec9b297f2741945d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:52.014854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:52.015256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:52.016804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1147/2284] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:51 2022] DELETE /identity/v3/projects/3cfdd3078cce48ec9b297f2741945d3d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:52.017558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.019343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.046681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:52.078844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b38b9e-82c6-44de-8d9c-c180660db2ce None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.088540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243e36-0225-4262-af95-8b20187a131f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.093365 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040351e-8a1b-482d-9210-16dcd829faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.094216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040351e-8a1b-482d-9210-16dcd829faab admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.094501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040351e-8a1b-482d-9210-16dcd829faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.094774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040351e-8a1b-482d-9210-16dcd829faab admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.095456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040351e-8a1b-482d-9210-16dcd829faab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.097408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040351e-8a1b-482d-9210-16dcd829faab admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.132035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1148/2285] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:52.134255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7711ee-e1f9-4843-aff4-6cbd694eb60c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.134554 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7711ee-e1f9-4843-aff4-6cbd694eb60c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.135505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7711ee-e1f9-4843-aff4-6cbd694eb60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.145100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.146004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.146973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.147662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.149817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.159517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ef7711ee-e1f9-4843-aff4-6cbd694eb60c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:52.160606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ef7711ee-e1f9-4843-aff4-6cbd694eb60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.224230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.228199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.236910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1149/2286] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:52.237587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7711ee-e1f9-4843-aff4-6cbd694eb60c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.242186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1138/2287] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:52.243080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.244515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.247737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7711ee-e1f9-4843-aff4-6cbd694eb60c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.256412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fe054-78df-4184-b4f5-61a365ba3d03 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.258767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134f8a-02b9-4cd1-bafc-3727bd77b7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.260044 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134f8a-02b9-4cd1-bafc-3727bd77b7ff admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.260548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134f8a-02b9-4cd1-bafc-3727bd77b7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.261095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134f8a-02b9-4cd1-bafc-3727bd77b7ff admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.262446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134f8a-02b9-4cd1-bafc-3727bd77b7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.265698 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134f8a-02b9-4cd1-bafc-3727bd77b7ff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.295170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1150/2288] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:52.295170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23313-7c38-4426-93dd-e57039c5ae90 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.295170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23313-7c38-4426-93dd-e57039c5ae90 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.295170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23313-7c38-4426-93dd-e57039c5ae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.318892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e2b23313-7c38-4426-93dd-e57039c5ae90 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:52.320281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e2b23313-7c38-4426-93dd-e57039c5ae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.324958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.325848 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.326209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.326616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.329087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.329223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1151/2289] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:52.332862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b23313-7c38-4426-93dd-e57039c5ae90 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.341855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:52.348750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b23313-7c38-4426-93dd-e57039c5ae90 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.355324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae3a05-b09a-4ae5-a6e3-f0b3dae75a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.356190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae3a05-b09a-4ae5-a6e3-f0b3dae75a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.356875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae3a05-b09a-4ae5-a6e3-f0b3dae75a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.356989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae3a05-b09a-4ae5-a6e3-f0b3dae75a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.357821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae3a05-b09a-4ae5-a6e3-f0b3dae75a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.359619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae3a05-b09a-4ae5-a6e3-f0b3dae75a8a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.371569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1152/2290] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:52.372484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae3a05-b09a-4ae5-a6e3-f0b3dae75a8a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.390892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae3a05-b09a-4ae5-a6e3-f0b3dae75a8a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.397271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.397956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.398344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.398683 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.399490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:37:52.399962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.401717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:52.401841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.418385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1153/2291] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:37:52.420644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.422166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.423116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.433806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a704-15d4-4772-9151-4cc6c3ac3218 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.437785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1139/2292] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:52.438590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.439835 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb79f-c271-46bc-8de9-6a5d5b72845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.440673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb79f-c271-46bc-8de9-6a5d5b72845b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.441204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb79f-c271-46bc-8de9-6a5d5b72845b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.441592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb79f-c271-46bc-8de9-6a5d5b72845b admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.442588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb79f-c271-46bc-8de9-6a5d5b72845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.445237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb79f-c271-46bc-8de9-6a5d5b72845b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.453806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd84788-5134-4385-9871-0ec594df3e04 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.461903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1154/2293] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:52.462074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa61a7-0f56-4a80-8a92-3cf2d3a2ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.462074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa61a7-0f56-4a80-8a92-3cf2d3a2ecdd admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.462074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa61a7-0f56-4a80-8a92-3cf2d3a2ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.462074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa61a7-0f56-4a80-8a92-3cf2d3a2ecdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.462399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa61a7-0f56-4a80-8a92-3cf2d3a2ecdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.463504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb79f-c271-46bc-8de9-6a5d5b72845b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.463613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa61a7-0f56-4a80-8a92-3cf2d3a2ecdd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.478530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb79f-c271-46bc-8de9-6a5d5b72845b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.486436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabfcf8-57b0-4476-8476-c8994589df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.487313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabfcf8-57b0-4476-8476-c8994589df21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.487641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabfcf8-57b0-4476-8476-c8994589df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.487921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabfcf8-57b0-4476-8476-c8994589df21 admin admin] PATH_INFO: `/v3/projects/aad697498f4b4402ac23964463dafa92/users/f733d135af024ae8af26218b0814b5e7/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.498959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1140/2294] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:52.500466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa61a7-0f56-4a80-8a92-3cf2d3a2ecdd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.511318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabfcf8-57b0-4476-8476-c8994589df21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad697498f4b4402ac23964463dafa92, user_id=f733d135af024ae8af26218b0814b5e7, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.515647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabfcf8-57b0-4476-8476-c8994589df21 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.535718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1155/2295] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:52 2022] PUT /identity/v3/projects/aad697498f4b4402ac23964463dafa92/users/f733d135af024ae8af26218b0814b5e7/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:52.547012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eac0b-60ef-4eb1-b542-acbaa4a35d66 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.547261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eac0b-60ef-4eb1-b542-acbaa4a35d66 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.547612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eac0b-60ef-4eb1-b542-acbaa4a35d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.595061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-695eac0b-60ef-4eb1-b542-acbaa4a35d66 None None] MFA Rules not processed for user `f733d135af024ae8af26218b0814b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:52.596461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-695eac0b-60ef-4eb1-b542-acbaa4a35d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:52.617432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa61a7-0f56-4a80-8a92-3cf2d3a2ecdd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.715979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a21d52-1007-46d3-bd3a-d62ad73869b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.717852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a21d52-1007-46d3-bd3a-d62ad73869b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.718300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a21d52-1007-46d3-bd3a-d62ad73869b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.718839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a21d52-1007-46d3-bd3a-d62ad73869b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.719695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a21d52-1007-46d3-bd3a-d62ad73869b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.722044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a21d52-1007-46d3-bd3a-d62ad73869b6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.765755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1141/2296] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:52.766768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1156/2297] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:52.772743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eac0b-60ef-4eb1-b542-acbaa4a35d66 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.783009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a21d52-1007-46d3-bd3a-d62ad73869b6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.786505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eac0b-60ef-4eb1-b542-acbaa4a35d66 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.794309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6f263-b88b-4a51-a562-27e41e6568ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.795305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f263-b88b-4a51-a562-27e41e6568ad admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.796048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f263-b88b-4a51-a562-27e41e6568ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.796409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f263-b88b-4a51-a562-27e41e6568ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.796658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a21d52-1007-46d3-bd3a-d62ad73869b6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.797542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6f263-b88b-4a51-a562-27e41e6568ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.799760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6f263-b88b-4a51-a562-27e41e6568ad admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.801678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae55b-4642-44b5-b94c-f0362524fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.802968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae55b-4642-44b5-b94c-f0362524fae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.803265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae55b-4642-44b5-b94c-f0362524fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.803599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae55b-4642-44b5-b94c-f0362524fae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.804949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae55b-4642-44b5-b94c-f0362524fae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.806649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae55b-4642-44b5-b94c-f0362524fae0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.823459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1142/2298] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:52.825065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae55b-4642-44b5-b94c-f0362524fae0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.836678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae55b-4642-44b5-b94c-f0362524fae0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.843339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1157/2299] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:52.845835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6652b-0c1c-4c45-adcb-d7424062fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.846621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6652b-0c1c-4c45-adcb-d7424062fe22 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.847120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6652b-0c1c-4c45-adcb-d7424062fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.847426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6652b-0c1c-4c45-adcb-d7424062fe22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.847881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6f263-b88b-4a51-a562-27e41e6568ad admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.848222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6652b-0c1c-4c45-adcb-d7424062fe22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.849930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6652b-0c1c-4c45-adcb-d7424062fe22 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.861536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1143/2300] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:52.865980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6652b-0c1c-4c45-adcb-d7424062fe22 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.877209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6652b-0c1c-4c45-adcb-d7424062fe22 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.917065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:52.938676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6f263-b88b-4a51-a562-27e41e6568ad admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.944348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84927-94a7-409a-96c6-fbd7b56c0572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.945127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84927-94a7-409a-96c6-fbd7b56c0572 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.945410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84927-94a7-409a-96c6-fbd7b56c0572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.945691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84927-94a7-409a-96c6-fbd7b56c0572 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.946384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d84927-94a7-409a-96c6-fbd7b56c0572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.948350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d84927-94a7-409a-96c6-fbd7b56c0572 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.948485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7eb4d2-12fe-4529-b136-13f084783b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:52.949424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eb4d2-12fe-4529-b136-13f084783b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.949702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eb4d2-12fe-4529-b136-13f084783b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.949976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eb4d2-12fe-4529-b136-13f084783b47 admin admin] PATH_INFO: `/v3/projects/1e633e4c115040a39a0604c812e1475b/users/b8e78886edbc4ee8aaf4efc77e0316f8/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:52.965195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:52.966361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7eb4d2-12fe-4529-b136-13f084783b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e633e4c115040a39a0604c812e1475b, user_id=b8e78886edbc4ee8aaf4efc77e0316f8, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:52.970092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7eb4d2-12fe-4529-b136-13f084783b47 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:52.971467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1158/2301] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:37:52.976072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84927-94a7-409a-96c6-fbd7b56c0572 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:52.985048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1144/2302] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:52 2022] PUT /identity/v3/projects/1e633e4c115040a39a0604c812e1475b/users/b8e78886edbc4ee8aaf4efc77e0316f8/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:52.987317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84927-94a7-409a-96c6-fbd7b56c0572 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:52.993192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1199-886d-407c-9d6c-5a90eb7f107e None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:52.994136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1199-886d-407c-9d6c-5a90eb7f107e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:52.995078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1199-886d-407c-9d6c-5a90eb7f107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.018998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1cdb1199-886d-407c-9d6c-5a90eb7f107e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:53.020528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1cdb1199-886d-407c-9d6c-5a90eb7f107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.055124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee050e4-81e0-41ed-842b-1e78610f92b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.055857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee050e4-81e0-41ed-842b-1e78610f92b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.056149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee050e4-81e0-41ed-842b-1e78610f92b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.056436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee050e4-81e0-41ed-842b-1e78610f92b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.057422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee050e4-81e0-41ed-842b-1e78610f92b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.059049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee050e4-81e0-41ed-842b-1e78610f92b6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.070590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1159/2303] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:37:53.075340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee050e4-81e0-41ed-842b-1e78610f92b6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.096804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee050e4-81e0-41ed-842b-1e78610f92b6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.105886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1145/2304] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:53.113748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd000f-3b71-4de4-a20d-4a33cab4a01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.117314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd000f-3b71-4de4-a20d-4a33cab4a01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.117314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd000f-3b71-4de4-a20d-4a33cab4a01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.117314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd000f-3b71-4de4-a20d-4a33cab4a01c admin admin] PATH_INFO: `/v3/projects/2aeadfe29b464f51ac22be0efcb7d30d/users/12354053f89541a18fb620b3210a5a65/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.120521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb1199-886d-407c-9d6c-5a90eb7f107e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.122462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1cdb1199-886d-407c-9d6c-5a90eb7f107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.146571 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd000f-3b71-4de4-a20d-4a33cab4a01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aeadfe29b464f51ac22be0efcb7d30d, user_id=12354053f89541a18fb620b3210a5a65, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.149744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd000f-3b71-4de4-a20d-4a33cab4a01c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.169123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1160/2305] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:53 2022] PUT /identity/v3/projects/2aeadfe29b464f51ac22be0efcb7d30d/users/12354053f89541a18fb620b3210a5a65/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:53.172811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd000f-3b71-4de4-a20d-4a33cab4a01c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.206053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb1199-886d-407c-9d6c-5a90eb7f107e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.243867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd000f-3b71-4de4-a20d-4a33cab4a01c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.248575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753033-2eee-4417-9ab1-8bf3316e5056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.249388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753033-2eee-4417-9ab1-8bf3316e5056 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.249679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753033-2eee-4417-9ab1-8bf3316e5056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.249955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753033-2eee-4417-9ab1-8bf3316e5056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.250672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96753033-2eee-4417-9ab1-8bf3316e5056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.252266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96753033-2eee-4417-9ab1-8bf3316e5056 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.256809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8084c4-c148-438e-986f-e9ff8e5b5aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.257484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8084c4-c148-438e-986f-e9ff8e5b5aae service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.257767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8084c4-c148-438e-986f-e9ff8e5b5aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.258048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8084c4-c148-438e-986f-e9ff8e5b5aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.261994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1161/2306] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:37:53.266001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753033-2eee-4417-9ab1-8bf3316e5056 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.267334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8084c4-c148-438e-986f-e9ff8e5b5aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.268763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8084c4-c148-438e-986f-e9ff8e5b5aae service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.275507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753033-2eee-4417-9ab1-8bf3316e5056 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.278468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1146/2307] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:53.280302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.281227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.281524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.281788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] PATH_INFO: `/v3/projects/2aeadfe29b464f51ac22be0efcb7d30d/users/12354053f89541a18fb620b3210a5a65/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.283772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aeadfe29b464f51ac22be0efcb7d30d, user_id=12354053f89541a18fb620b3210a5a65, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.286428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.299426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1162/2308] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:37:53 2022] PUT /identity/v3/projects/2aeadfe29b464f51ac22be0efcb7d30d/users/12354053f89541a18fb620b3210a5a65/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:53.311397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e8f4-48f2-4eb0-9c48-a91929c7a65a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.311693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e8f4-48f2-4eb0-9c48-a91929c7a65a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.311974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e8f4-48f2-4eb0-9c48-a91929c7a65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.343285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b798e8f4-48f2-4eb0-9c48-a91929c7a65a None None] MFA Rules not processed for user `12354053f89541a18fb620b3210a5a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:53.344600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b798e8f4-48f2-4eb0-9c48-a91929c7a65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.354492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:53.418909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1147/2309] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:53.430776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.432519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.495421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953216-7559-429a-a370-495954fefa33 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.499256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e40c1-b620-450d-8975-dafcb55cac4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.500029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e40c1-b620-450d-8975-dafcb55cac4b service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.500314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e40c1-b620-450d-8975-dafcb55cac4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.500588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e40c1-b620-450d-8975-dafcb55cac4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.510304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e40c1-b620-450d-8975-dafcb55cac4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.511905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e40c1-b620-450d-8975-dafcb55cac4b service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.515921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:53.525461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1163/2310] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:53.571616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798e8f4-48f2-4eb0-9c48-a91929c7a65a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:53.582871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798e8f4-48f2-4eb0-9c48-a91929c7a65a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:53.587215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:53.587940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:53.588292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:53.588645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:53.590658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:53.671786 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:53.673436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:53.687553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1148/2311] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:54.209187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e40c1-b620-450d-8975-dafcb55cac4b service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:54.221697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e40c1-b620-450d-8975-dafcb55cac4b service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:54.239364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:54.240705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.242867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.243273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.248223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:54.392350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:54.394004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:54.413308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1164/2312] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:54.482926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:54.492229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2685b3b-cd5e-4a59-885b-c92da894745d service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:54.498056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:54.498727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:54.499019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:54.499617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:54.502111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:54.612946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:54.615491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:54.627713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1149/2313] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:55.374910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:55.389926 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7a33a-29b0-4bf3-b9a8-3c4ea1377adb service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:55.406489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e59da7-0c79-4368-9fba-ae8a7e61e2c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:55.408185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e59da7-0c79-4368-9fba-ae8a7e61e2c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:55.408679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e59da7-0c79-4368-9fba-ae8a7e61e2c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:55.409771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e59da7-0c79-4368-9fba-ae8a7e61e2c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:55.417143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-48e59da7-0c79-4368-9fba-ae8a7e61e2c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:55.525558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e59da7-0c79-4368-9fba-ae8a7e61e2c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:55.527841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e59da7-0c79-4368-9fba-ae8a7e61e2c7 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:55.540488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1165/2314] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:57.089576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:57.225486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:57.297263 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841232ee-462e-4066-a9fe-29dbd9255846 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:57.307514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:57.308375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:57.308657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:57.308965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] PATH_INFO: `/v3/users/8751e209cc9341b1a29cd861739503f1` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:57.313768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8751e209cc9341b1a29cd861739503f1)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:57.321017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:57.401493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8751e209cc9341b1a29cd861739503f1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:57.424047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8751e209cc9341b1a29cd861739503f1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:57.424905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8751e209cc9341b1a29cd861739503f1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:57.437228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8751e209cc9341b1a29cd861739503f1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:57.438230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8751e209cc9341b1a29cd861739503f1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:57.469708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528638b-7de0-469b-9bc6-907f082f39b9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:57.470265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528638b-7de0-469b-9bc6-907f082f39b9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:57.470265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528638b-7de0-469b-9bc6-907f082f39b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:57.481914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1150/2315] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:57 2022] DELETE /identity/v3/users/8751e209cc9341b1a29cd861739503f1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:57.492451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3528638b-7de0-469b-9bc6-907f082f39b9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:57.494253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3528638b-7de0-469b-9bc6-907f082f39b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:57.576015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1166/2316] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:57.584051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:57.585546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:57.670725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313d519-9148-4bcc-ae05-d02adf1f8e34 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:57.674409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedbd23-3a73-4b83-90ed-b50160ac51b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:57.675067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbd23-3a73-4b83-90ed-b50160ac51b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:57.675356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbd23-3a73-4b83-90ed-b50160ac51b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:57.675640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbd23-3a73-4b83-90ed-b50160ac51b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:57.688681 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedbd23-3a73-4b83-90ed-b50160ac51b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:57.690184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedbd23-3a73-4b83-90ed-b50160ac51b0 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:57.703190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1151/2317] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:58.181155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528638b-7de0-469b-9bc6-907f082f39b9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:58.183023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3528638b-7de0-469b-9bc6-907f082f39b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:58.197803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528638b-7de0-469b-9bc6-907f082f39b9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:58.211901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:58.213319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:58.213831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:58.214330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] PATH_INFO: `/v3/projects/6e5f1fba40b345e9931e4ffc48e4ffe0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:58.216493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5f1fba40b345e9931e4ffc48e4ffe0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:58.219866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:58.291637 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:58.326920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5f1fba40b345e9931e4ffc48e4ffe0', 'request_id': 'req-286a04fa-4571-4ea7-9e01-030d278d842b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.333198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5f1fba40b345e9931e4ffc48e4ffe0', 'request_id': 'req-286a04fa-4571-4ea7-9e01-030d278d842b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.340664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5f1fba40b345e9931e4ffc48e4ffe0', 'request_id': 'req-286a04fa-4571-4ea7-9e01-030d278d842b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.369600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] The token cache is being invalidate because project 6e5f1fba40b345e9931e4ffc48e4ffe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:58.369600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.369600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.369600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1167/2318] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:58 2022] DELETE /identity/v3/projects/6e5f1fba40b345e9931e4ffc48e4ffe0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:58.373037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedbd23-3a73-4b83-90ed-b50160ac51b0 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:58.386128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedbd23-3a73-4b83-90ed-b50160ac51b0 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:58.513476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:58.514435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:58.514790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:58.515134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] PATH_INFO: `/v3/users/f733d135af024ae8af26218b0814b5e7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:58.517444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f733d135af024ae8af26218b0814b5e7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:58.522148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:58.524328 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:58.657417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f733d135af024ae8af26218b0814b5e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.696963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f733d135af024ae8af26218b0814b5e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.701388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f733d135af024ae8af26218b0814b5e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.717308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f733d135af024ae8af26218b0814b5e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.718131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f733d135af024ae8af26218b0814b5e7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:58.750359 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1152/2319] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:58 2022] DELETE /identity/v3/users/f733d135af024ae8af26218b0814b5e7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:37:59.251088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:59.253785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:59.284007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a04fa-4571-4ea7-9e01-030d278d842b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:59.367430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:59.368479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:59.368982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:59.369582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] PATH_INFO: `/v3/projects/aad697498f4b4402ac23964463dafa92` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:59.371002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad697498f4b4402ac23964463dafa92)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:59.373192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:59.445824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad697498f4b4402ac23964463dafa92', 'request_id': 'req-5814b694-66c6-4a80-be53-d0c145320d07'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.452564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad697498f4b4402ac23964463dafa92', 'request_id': 'req-5814b694-66c6-4a80-be53-d0c145320d07'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.461543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad697498f4b4402ac23964463dafa92', 'request_id': 'req-5814b694-66c6-4a80-be53-d0c145320d07'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.479899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] The token cache is being invalidate because project aad697498f4b4402ac23964463dafa92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:37:59.480245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.481141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5814b694-66c6-4a80-be53-d0c145320d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.486337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1168/2320] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:37:59 2022] DELETE /identity/v3/projects/aad697498f4b4402ac23964463dafa92 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:59.487568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:59.490052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:59.510114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e5c0c-5a98-46fb-a374-65358b3cdae4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:59.588532 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49b5c9-aac4-49e7-b425-4fda1fb070af None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:59.589046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49b5c9-aac4-49e7-b425-4fda1fb070af None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:59.589493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49b5c9-aac4-49e7-b425-4fda1fb070af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:59.594447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:59.596217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:59.596701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:59.597226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] PATH_INFO: `/v3/users/12354053f89541a18fb620b3210a5a65` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:59.600053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12354053f89541a18fb620b3210a5a65)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:59.602663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:59.629105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cb49b5c9-aac4-49e7-b425-4fda1fb070af None None] MFA Rules not processed for user `b8e78886edbc4ee8aaf4efc77e0316f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:59.630327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cb49b5c9-aac4-49e7-b425-4fda1fb070af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:59.673889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12354053f89541a18fb620b3210a5a65'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.688248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:59.689661 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12354053f89541a18fb620b3210a5a65'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.690590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12354053f89541a18fb620b3210a5a65'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.702882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12354053f89541a18fb620b3210a5a65'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.704346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12354053f89541a18fb620b3210a5a65'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:37:59.718004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:59.724719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1153/2321] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:37:59 2022] DELETE /identity/v3/users/12354053f89541a18fb620b3210a5a65 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:37:59.751550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1169/2322] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:37:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:37:59.756698 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:59.758234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:59.864341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cb093-f359-4992-b83b-8a802f5e5336 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:59.875994 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ae9c4-def7-4551-b33c-9b7be84a524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:59.878987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ae9c4-def7-4551-b33c-9b7be84a524a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:59.879292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ae9c4-def7-4551-b33c-9b7be84a524a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:59.879581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ae9c4-def7-4551-b33c-9b7be84a524a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:59.881498 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ae9c4-def7-4551-b33c-9b7be84a524a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:59.883814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ae9c4-def7-4551-b33c-9b7be84a524a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:59.937346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49b5c9-aac4-49e7-b425-4fda1fb070af None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:59.938398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1154/2323] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:37:59 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:37:59.958137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49b5c9-aac4-49e7-b425-4fda1fb070af None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.028494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.029929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.030488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.031073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.032293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.034915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.058273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1170/2324] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:37:59 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:00.062156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ae9c4-def7-4551-b33c-9b7be84a524a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.077895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ae9c4-def7-4551-b33c-9b7be84a524a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.091089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.091905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.092542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.092729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.093660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.095279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.105557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.107541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.124332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3dd47-9ce3-418c-a609-c99cc5812b01 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.126950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1155/2325] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:00.128076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.129803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.130228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.131801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.132207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.132765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] PATH_INFO: `/v3/projects/2aeadfe29b464f51ac22be0efcb7d30d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.134703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aeadfe29b464f51ac22be0efcb7d30d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.136817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.153276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bc601-6413-4b82-bbe3-ae0eb1339348 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.158896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.160147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.160416 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.160754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] PATH_INFO: `/v3/users/015bdfa1facc48a8896dd5651a20a4ec` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.162395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=015bdfa1facc48a8896dd5651a20a4ec)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.165816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.202497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aeadfe29b464f51ac22be0efcb7d30d', 'request_id': 'req-7c915ff3-ec60-422d-81a4-0c344279424e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.215974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aeadfe29b464f51ac22be0efcb7d30d', 'request_id': 'req-7c915ff3-ec60-422d-81a4-0c344279424e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.216180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aeadfe29b464f51ac22be0efcb7d30d', 'request_id': 'req-7c915ff3-ec60-422d-81a4-0c344279424e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.231875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015bdfa1facc48a8896dd5651a20a4ec'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.232360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] The token cache is being invalidate because project 2aeadfe29b464f51ac22be0efcb7d30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:00.232654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.233356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.237126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1171/2326] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:00 2022] DELETE /identity/v3/projects/2aeadfe29b464f51ac22be0efcb7d30d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:00.237126 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.238143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.251295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015bdfa1facc48a8896dd5651a20a4ec'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.252099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015bdfa1facc48a8896dd5651a20a4ec'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.261422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015bdfa1facc48a8896dd5651a20a4ec'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.264061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-e59e211c-8ffd-46d6-ac2c-206db207fe77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015bdfa1facc48a8896dd5651a20a4ec'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.283615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1156/2327] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:00 2022] DELETE /identity/v3/users/015bdfa1facc48a8896dd5651a20a4ec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:00.283615 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8747c4b-d7e2-4a04-a707-14752fbc3d01 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.284100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8747c4b-d7e2-4a04-a707-14752fbc3d01 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.287131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8747c4b-d7e2-4a04-a707-14752fbc3d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.312405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e8747c4b-d7e2-4a04-a707-14752fbc3d01 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:00.314813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e8747c4b-d7e2-4a04-a707-14752fbc3d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.318596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:00.364204 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915ff3-ec60-422d-81a4-0c344279424e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.385779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:00.413997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1157/2328] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:00.413997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed872-328d-4e3a-8fab-f3cf43446488 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.413997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed872-328d-4e3a-8fab-f3cf43446488 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.413997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed872-328d-4e3a-8fab-f3cf43446488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.436732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-727ed872-328d-4e3a-8fab-f3cf43446488 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:00.438006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-727ed872-328d-4e3a-8fab-f3cf43446488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.441394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731c3e4-4e05-4509-a714-8a923da277b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.442343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731c3e4-4e05-4509-a714-8a923da277b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.442560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731c3e4-4e05-4509-a714-8a923da277b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.443410 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731c3e4-4e05-4509-a714-8a923da277b5 admin admin] PATH_INFO: `/v3/projects/cffb926fbfe74a82ad1ad4aa79762452/users/f933db5569464bbcb6bbf0bb62359d33/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.450912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1158/2329] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:00.452009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ed872-328d-4e3a-8fab-f3cf43446488 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.461377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-727ed872-328d-4e3a-8fab-f3cf43446488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.468630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731c3e4-4e05-4509-a714-8a923da277b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffb926fbfe74a82ad1ad4aa79762452, user_id=f933db5569464bbcb6bbf0bb62359d33, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.471408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731c3e4-4e05-4509-a714-8a923da277b5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.480869 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ed872-328d-4e3a-8fab-f3cf43446488 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.488447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.489438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.490300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.490899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] PATH_INFO: `/v3/users/fa969d4ab43e4858b077f8f55e9be8b8` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.492256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa969d4ab43e4858b077f8f55e9be8b8)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.494915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.504723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1172/2330] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:38:00 2022] PUT /identity/v3/projects/cffb926fbfe74a82ad1ad4aa79762452/users/f933db5569464bbcb6bbf0bb62359d33/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:00.506525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727ef1-aabe-416f-afa1-5f34367264ec None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.506828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727ef1-aabe-416f-afa1-5f34367264ec None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.507112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727ef1-aabe-416f-afa1-5f34367264ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.527013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-96727ef1-aabe-416f-afa1-5f34367264ec None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:00.528398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-96727ef1-aabe-416f-afa1-5f34367264ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.576790 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa969d4ab43e4858b077f8f55e9be8b8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.592577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa969d4ab43e4858b077f8f55e9be8b8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.594110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa969d4ab43e4858b077f8f55e9be8b8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.604197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa969d4ab43e4858b077f8f55e9be8b8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.605111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa969d4ab43e4858b077f8f55e9be8b8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:00.607255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1173/2331] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:00.608071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96727ef1-aabe-416f-afa1-5f34367264ec None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.609944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-96727ef1-aabe-416f-afa1-5f34367264ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.624332 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1159/2332] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:00 2022] DELETE /identity/v3/users/fa969d4ab43e4858b077f8f55e9be8b8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:00.625373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.626797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.687178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96727ef1-aabe-416f-afa1-5f34367264ec None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.709499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058a39a-9a20-46b5-8240-fe2835800e07 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.716397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe84e80-901d-4649-9cca-0732896e228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.717793 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84e80-901d-4649-9cca-0732896e228d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.718330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84e80-901d-4649-9cca-0732896e228d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.718814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84e80-901d-4649-9cca-0732896e228d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.719814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe84e80-901d-4649-9cca-0732896e228d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.723549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe84e80-901d-4649-9cca-0732896e228d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.729613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:00.744605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1160/2333] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:00.746389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe84e80-901d-4649-9cca-0732896e228d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.756098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b8af7-7dff-485f-a415-4bbc6e7594b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.757966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8af7-7dff-485f-a415-4bbc6e7594b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.757966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8af7-7dff-485f-a415-4bbc6e7594b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.757966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b8af7-7dff-485f-a415-4bbc6e7594b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.759543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe84e80-901d-4649-9cca-0732896e228d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.760035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a19b8af7-7dff-485f-a415-4bbc6e7594b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.767273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.771300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.772111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.772602 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.773883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:00.774411 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.776346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.779581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b8af7-7dff-485f-a415-4bbc6e7594b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.781386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b8af7-7dff-485f-a415-4bbc6e7594b4 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.793620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1174/2334] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:00.794635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1161/2335] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:00.795712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.796453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7afb6-2b5f-4484-9e6c-b574e8216ab2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.796998 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7afb6-2b5f-4484-9e6c-b574e8216ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.797473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7afb6-2b5f-4484-9e6c-b574e8216ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.808152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6e9ad-1f7a-472e-ba81-2461208c205b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:00.813065 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d53c-b99a-4a48-8bbf-15d071050e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:00.814018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d53c-b99a-4a48-8bbf-15d071050e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:00.814404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d53c-b99a-4a48-8bbf-15d071050e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:00.814846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d53c-b99a-4a48-8bbf-15d071050e10 admin admin] PATH_INFO: `/v3/projects/cffb926fbfe74a82ad1ad4aa79762452/users/f933db5569464bbcb6bbf0bb62359d33/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:00.817258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d53c-b99a-4a48-8bbf-15d071050e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffb926fbfe74a82ad1ad4aa79762452, user_id=f933db5569464bbcb6bbf0bb62359d33, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:00.819922 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d53c-b99a-4a48-8bbf-15d071050e10 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:00.834300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a7c7afb6-2b5f-4484-9e6c-b574e8216ab2 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:00.835840 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a7c7afb6-2b5f-4484-9e6c-b574e8216ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:00.840005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1162/2336] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:38:00 2022] PUT /identity/v3/projects/cffb926fbfe74a82ad1ad4aa79762452/users/f933db5569464bbcb6bbf0bb62359d33/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:00.844707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d53c-b99a-4a48-8bbf-15d071050e10 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:00.915158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:01.016039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d53c-b99a-4a48-8bbf-15d071050e10 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.035932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639dff-97d9-4a55-8881-c699c050ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.036658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639dff-97d9-4a55-8881-c699c050ced6 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.040676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639dff-97d9-4a55-8881-c699c050ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.041000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639dff-97d9-4a55-8881-c699c050ced6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.041745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24639dff-97d9-4a55-8881-c699c050ced6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.050648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24639dff-97d9-4a55-8881-c699c050ced6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.107915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1163/2337] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:38:00 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:01.110635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1175/2338] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:01.112235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639dff-97d9-4a55-8881-c699c050ced6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.126778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7afb6-2b5f-4484-9e6c-b574e8216ab2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.130189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a7c7afb6-2b5f-4484-9e6c-b574e8216ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:01.288372 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639dff-97d9-4a55-8881-c699c050ced6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.290294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7afb6-2b5f-4484-9e6c-b574e8216ab2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.318161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66534756-7e05-4b44-8d19-b7a429701fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.318944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534756-7e05-4b44-8d19-b7a429701fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.319309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534756-7e05-4b44-8d19-b7a429701fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.319672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534756-7e05-4b44-8d19-b7a429701fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.320449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66534756-7e05-4b44-8d19-b7a429701fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.326168 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66534756-7e05-4b44-8d19-b7a429701fd8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.360370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1164/2339] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:38:01 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:01.364705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66534756-7e05-4b44-8d19-b7a429701fd8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.386723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66534756-7e05-4b44-8d19-b7a429701fd8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.403437 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.404222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.404506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.404785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.415274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.416956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.428669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6955-f108-4500-8638-85a43ddfd252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.431133 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6955-f108-4500-8638-85a43ddfd252 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.431423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6955-f108-4500-8638-85a43ddfd252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.431706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6955-f108-4500-8638-85a43ddfd252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.437719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1165/2340] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:01.439085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.441012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:01.451312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6955-f108-4500-8638-85a43ddfd252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.455579 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6955-f108-4500-8638-85a43ddfd252 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.460442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088e2df-56eb-40cd-a12a-668521ca8516 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.467781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.468735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.469117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.469467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] PATH_INFO: `/v3/projects/9c0fd38243c24a2d9cffc8400ff176b9` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.470739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0fd38243c24a2d9cffc8400ff176b9)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.473604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.488536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1176/2341] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:01.489497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6955-f108-4500-8638-85a43ddfd252 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.513804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6955-f108-4500-8638-85a43ddfd252 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.527671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7d228-6c5c-46dd-a47e-8dcbe11056b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.528580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d228-6c5c-46dd-a47e-8dcbe11056b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.529366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d228-6c5c-46dd-a47e-8dcbe11056b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.529366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d228-6c5c-46dd-a47e-8dcbe11056b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.530064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7d228-6c5c-46dd-a47e-8dcbe11056b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.531693 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7d228-6c5c-46dd-a47e-8dcbe11056b3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.564158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1177/2342] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:01.569235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7d228-6c5c-46dd-a47e-8dcbe11056b3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.575721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0fd38243c24a2d9cffc8400ff176b9', 'request_id': 'req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.589725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7d228-6c5c-46dd-a47e-8dcbe11056b3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.591502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0fd38243c24a2d9cffc8400ff176b9', 'request_id': 'req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.601032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0fd38243c24a2d9cffc8400ff176b9', 'request_id': 'req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.624973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] The token cache is being invalidate because project 9c0fd38243c24a2d9cffc8400ff176b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:01.625493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.626362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:01.631048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1166/2343] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:01 2022] DELETE /identity/v3/projects/9c0fd38243c24a2d9cffc8400ff176b9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:01.632447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:01.635316 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:01.637358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:01.674428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:01.777713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33104934-d1d2-473f-a67d-63ac3a629968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:01.778642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104934-d1d2-473f-a67d-63ac3a629968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.778906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104934-d1d2-473f-a67d-63ac3a629968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.779188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104934-d1d2-473f-a67d-63ac3a629968 admin admin] PATH_INFO: `/v3/projects/5fe88e92cd7346e6948ff580f98ddb19/users/3ff6440aa1c54abe840dac4390335744/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.834037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33104934-d1d2-473f-a67d-63ac3a629968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe88e92cd7346e6948ff580f98ddb19, user_id=3ff6440aa1c54abe840dac4390335744, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:01.836860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33104934-d1d2-473f-a67d-63ac3a629968 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:01.874251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1178/2344] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:38:01 2022] PUT /identity/v3/projects/5fe88e92cd7346e6948ff580f98ddb19/users/3ff6440aa1c54abe840dac4390335744/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:01.879025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988022-dab3-4fb0-952b-1f53bb3f2188 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:01.879253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988022-dab3-4fb0-952b-1f53bb3f2188 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:01.879541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988022-dab3-4fb0-952b-1f53bb3f2188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:01.883624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec71a96-eb06-49fb-b513-2cd6790cd8b7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:01.945134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-28988022-dab3-4fb0-952b-1f53bb3f2188 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:01.949774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-28988022-dab3-4fb0-952b-1f53bb3f2188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:02.051838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:02.053939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:02.054631 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:02.055090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] PATH_INFO: `/v3/users/01da9f17498f405bb1571254315e3520` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:02.056769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01da9f17498f405bb1571254315e3520)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:02.059524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:02.096201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1179/2345] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:02.097456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988022-dab3-4fb0-952b-1f53bb3f2188 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:02.105684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-28988022-dab3-4fb0-952b-1f53bb3f2188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:02.119480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988022-dab3-4fb0-952b-1f53bb3f2188 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:02.127620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:02.129906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:02.130722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:02.132062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] PATH_INFO: `/v3/projects/9a7fa516f0cc48729376c8fa123328fa` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:02.135392 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a7fa516f0cc48729376c8fa123328fa)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:02.139212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:02.142192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01da9f17498f405bb1571254315e3520'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.162739 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01da9f17498f405bb1571254315e3520'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.163785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01da9f17498f405bb1571254315e3520'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.176147 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01da9f17498f405bb1571254315e3520'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.177063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01da9f17498f405bb1571254315e3520'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.198115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1167/2346] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:01 2022] DELETE /identity/v3/users/01da9f17498f405bb1571254315e3520 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:02.199417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:02.203915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:02.259468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:02.270359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a7fa516f0cc48729376c8fa123328fa', 'request_id': 'req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.277538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a7fa516f0cc48729376c8fa123328fa', 'request_id': 'req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.285964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a7fa516f0cc48729376c8fa123328fa', 'request_id': 'req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.302505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] The token cache is being invalidate because project 9a7fa516f0cc48729376c8fa123328fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:02.303197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.304593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.309506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1180/2347] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:02 2022] DELETE /identity/v3/projects/9a7fa516f0cc48729376c8fa123328fa => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:02.313541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:02.314918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07ce7-8f7e-4bbc-99ca-9260fe58f723 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:02.315450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:02.405412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:02.420914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:02.424524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:02.425036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:02.425829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:02.432297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:02.447660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58be2a9-e5a7-47dc-be47-57d7a1c804ae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:02.453262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:02.454228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:02.454521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:02.454803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] PATH_INFO: `/v3/users/055c488c151d4e66b9b154f1f091ab96` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:02.456223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055c488c151d4e66b9b154f1f091ab96)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:02.458619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:02.468678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:02.474022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:02.525812 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1168/2348] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:02.548722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055c488c151d4e66b9b154f1f091ab96'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.568718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055c488c151d4e66b9b154f1f091ab96'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.587414 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055c488c151d4e66b9b154f1f091ab96'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.588076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055c488c151d4e66b9b154f1f091ab96'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.588750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055c488c151d4e66b9b154f1f091ab96'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:02.606305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1181/2349] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:02 2022] DELETE /identity/v3/users/055c488c151d4e66b9b154f1f091ab96 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:03.568879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.572042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:03.590528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edbb41-e702-4328-86aa-2032bcb8182c service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.705884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.707490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.708067 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.708224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] PATH_INFO: `/v3/projects/f80758a443b34d828cdc20a3bf4ae027` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.710670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80758a443b34d828cdc20a3bf4ae027)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.715877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.726744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.728396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:03.756962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171eea0-9760-4b94-8ab6-fece054753b1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:03.762568 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:03.764784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.765253 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.765689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] PATH_INFO: `/v3/projects/6576e0bc6f0b4bec8fd3642f2209cfba` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.767771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6576e0bc6f0b4bec8fd3642f2209cfba)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:03.770003 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:03.822064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80758a443b34d828cdc20a3bf4ae027', 'request_id': 'req-7d616791-c8e8-4e8f-8103-67f14d7805d1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.830154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80758a443b34d828cdc20a3bf4ae027', 'request_id': 'req-7d616791-c8e8-4e8f-8103-67f14d7805d1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.838991 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80758a443b34d828cdc20a3bf4ae027', 'request_id': 'req-7d616791-c8e8-4e8f-8103-67f14d7805d1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.861830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] The token cache is being invalidate because project f80758a443b34d828cdc20a3bf4ae027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:03.862131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.867379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6576e0bc6f0b4bec8fd3642f2209cfba', 'request_id': 'req-6ac77687-af2a-4bd4-85ab-5224bc601dec'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.867833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7d616791-c8e8-4e8f-8103-67f14d7805d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.870273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1169/2350] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:03 2022] DELETE /identity/v3/projects/f80758a443b34d828cdc20a3bf4ae027 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:03.875713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05967aa4-0d64-46a5-b837-44f7d07847c6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:03.876529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05967aa4-0d64-46a5-b837-44f7d07847c6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:03.876529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05967aa4-0d64-46a5-b837-44f7d07847c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:03.879181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6576e0bc6f0b4bec8fd3642f2209cfba', 'request_id': 'req-6ac77687-af2a-4bd4-85ab-5224bc601dec'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.893026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6576e0bc6f0b4bec8fd3642f2209cfba', 'request_id': 'req-6ac77687-af2a-4bd4-85ab-5224bc601dec'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.918491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-05967aa4-0d64-46a5-b837-44f7d07847c6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:03.919788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-05967aa4-0d64-46a5-b837-44f7d07847c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:03.920169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] The token cache is being invalidate because project 6576e0bc6f0b4bec8fd3642f2209cfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:03.920889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.921781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:03.925597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1182/2351] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:03 2022] DELETE /identity/v3/projects/6576e0bc6f0b4bec8fd3642f2209cfba => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:03.930507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:03.932485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:03.950669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:04.031263 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:04.075877 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1170/2352] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:04.086172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2635-a2c0-4622-a5ca-da9fca22d0cc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.086466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2635-a2c0-4622-a5ca-da9fca22d0cc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.086750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2635-a2c0-4622-a5ca-da9fca22d0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.092379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77687-af2a-4bd4-85ab-5224bc601dec admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.099294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.100651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.101326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.101326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] PATH_INFO: `/v3/users/dde406d042fe49e4994a140a28d5a4d8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.103364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde406d042fe49e4994a140a28d5a4d8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.105709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.121008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fc2d2635-a2c0-4622-a5ca-da9fca22d0cc None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:04.122675 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fc2d2635-a2c0-4622-a5ca-da9fca22d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.141806 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1171/2353] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:04.149967 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d2635-a2c0-4622-a5ca-da9fca22d0cc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.162405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d2635-a2c0-4622-a5ca-da9fca22d0cc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.175824 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.176555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.176912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.178187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.180130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:04.180457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.182326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.199255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1172/2354] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:04.206732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde406d042fe49e4994a140a28d5a4d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:04.213901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.226032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed8fb-10c7-4a05-824e-d35cb10290ff admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.226939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde406d042fe49e4994a140a28d5a4d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:04.241571 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa3d2d-a1a3-403c-af23-e96030d0c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.242763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3d2d-a1a3-403c-af23-e96030d0c315 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.242763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3d2d-a1a3-403c-af23-e96030d0c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.242961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3d2d-a1a3-403c-af23-e96030d0c315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.243509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa3d2d-a1a3-403c-af23-e96030d0c315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.245493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa3d2d-a1a3-403c-af23-e96030d0c315 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.247343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde406d042fe49e4994a140a28d5a4d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:04.248201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde406d042fe49e4994a140a28d5a4d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:04.257594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde406d042fe49e4994a140a28d5a4d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:04.282280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1183/2355] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:03 2022] DELETE /identity/v3/users/dde406d042fe49e4994a140a28d5a4d8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:04.325836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.327191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1173/2356] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:38:04 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:04.329982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.419166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c328c8-5b7b-4cbd-a80d-169cb8006917 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.419536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c328c8-5b7b-4cbd-a80d-169cb8006917 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.419894 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c328c8-5b7b-4cbd-a80d-169cb8006917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.498049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-66c328c8-5b7b-4cbd-a80d-169cb8006917 None None] MFA Rules not processed for user `3ff6440aa1c54abe840dac4390335744`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:04.499564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9927d24-d842-436b-9c61-15d9ac42ba51 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.500624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-66c328c8-5b7b-4cbd-a80d-169cb8006917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.736116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07d10d-c8aa-453a-86c3-c0e4776d597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.736813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07d10d-c8aa-453a-86c3-c0e4776d597d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.737128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07d10d-c8aa-453a-86c3-c0e4776d597d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.737402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07d10d-c8aa-453a-86c3-c0e4776d597d admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.738095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07d10d-c8aa-453a-86c3-c0e4776d597d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.740099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07d10d-c8aa-453a-86c3-c0e4776d597d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.757402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:04.760011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1174/2357] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:04.775500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c328c8-5b7b-4cbd-a80d-169cb8006917 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.778286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-66c328c8-5b7b-4cbd-a80d-169cb8006917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.787614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1184/2358] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:38:04 2022] POST /identity/v3/users => generated 281 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:04.791518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07d10d-c8aa-453a-86c3-c0e4776d597d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.809645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07d10d-c8aa-453a-86c3-c0e4776d597d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.834448 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c983f-a0fd-49e2-b041-dc1c8f9cbbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.835136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c983f-a0fd-49e2-b041-dc1c8f9cbbcb admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.835424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c983f-a0fd-49e2-b041-dc1c8f9cbbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.835707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c983f-a0fd-49e2-b041-dc1c8f9cbbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.836557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c983f-a0fd-49e2-b041-dc1c8f9cbbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.855325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c983f-a0fd-49e2-b041-dc1c8f9cbbcb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.897949 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1185/2359] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:04.899498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c983f-a0fd-49e2-b041-dc1c8f9cbbcb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.923201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c983f-a0fd-49e2-b041-dc1c8f9cbbcb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.949635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.950782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.951279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.951617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:04.952581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:04.954671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:04.973055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1186/2360] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:04.974645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:04.977088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:04.989735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c328c8-5b7b-4cbd-a80d-169cb8006917 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:04.994155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a438a4-d617-4624-89d8-92eb186caaa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:04.995445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a438a4-d617-4624-89d8-92eb186caaa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:04.995830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a438a4-d617-4624-89d8-92eb186caaa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:04.996123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a438a4-d617-4624-89d8-92eb186caaa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.006847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e9ef-9040-4df3-bf95-0436c19a336f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:05.018182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a438a4-d617-4624-89d8-92eb186caaa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:05.019558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:05.022775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.022775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.022775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] PATH_INFO: `/v3/projects/8a174716d6754b9dba20c076296b6c2e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.023222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a438a4-d617-4624-89d8-92eb186caaa7 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:05.026605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a174716d6754b9dba20c076296b6c2e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:05.032861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:05.053097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1175/2361] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:05.055715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a438a4-d617-4624-89d8-92eb186caaa7 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:05.098352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a438a4-d617-4624-89d8-92eb186caaa7 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:05.111172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02883b0-3528-4f91-b9d2-3f3f1120147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:05.112078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02883b0-3528-4f91-b9d2-3f3f1120147d admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.112364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02883b0-3528-4f91-b9d2-3f3f1120147d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.113031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02883b0-3528-4f91-b9d2-3f3f1120147d admin admin] PATH_INFO: `/v3/projects/bf70a6a1516a497489e3493bcbd85281/users/e2273a55456d45ea9c0f65943e09cbc2/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.147185 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:05.165026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02883b0-3528-4f91-b9d2-3f3f1120147d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf70a6a1516a497489e3493bcbd85281, user_id=e2273a55456d45ea9c0f65943e09cbc2, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:05.174424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02883b0-3528-4f91-b9d2-3f3f1120147d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:05.210792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1176/2362] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:38:05 2022] PUT /identity/v3/projects/bf70a6a1516a497489e3493bcbd85281/users/e2273a55456d45ea9c0f65943e09cbc2/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:05.227656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544f98-99ca-4b03-aa94-5ad9d45d4a65 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.227942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544f98-99ca-4b03-aa94-5ad9d45d4a65 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.228237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544f98-99ca-4b03-aa94-5ad9d45d4a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.247512 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a174716d6754b9dba20c076296b6c2e', 'request_id': 'req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:05.271237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a174716d6754b9dba20c076296b6c2e', 'request_id': 'req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:05.284674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a174716d6754b9dba20c076296b6c2e', 'request_id': 'req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:05.317040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] The token cache is being invalidate because project 8a174716d6754b9dba20c076296b6c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:05.317430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:05.318872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b34fd6a-87a3-4f2f-a183-99e5266af8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:05.321679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1187/2363] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:04 2022] DELETE /identity/v3/projects/8a174716d6754b9dba20c076296b6c2e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:05.322454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f1544f98-99ca-4b03-aa94-5ad9d45d4a65 None None] MFA Rules not processed for user `e2273a55456d45ea9c0f65943e09cbc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:05.323663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f1544f98-99ca-4b03-aa94-5ad9d45d4a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:05.327676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc1a87-4957-462c-abb6-aebf53869b54 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.328071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc1a87-4957-462c-abb6-aebf53869b54 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.328422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc1a87-4957-462c-abb6-aebf53869b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.367274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dccc1a87-4957-462c-abb6-aebf53869b54 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:05.372055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dccc1a87-4957-462c-abb6-aebf53869b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:05.511157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1177/2364] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:05.552984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1188/2365] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:05.558702 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344ce5-a9f0-4359-9c07-538090d4d2c9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.559307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344ce5-a9f0-4359-9c07-538090d4d2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.566622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344ce5-a9f0-4359-9c07-538090d4d2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.597672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bb344ce5-a9f0-4359-9c07-538090d4d2c9 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:05.599396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bb344ce5-a9f0-4359-9c07-538090d4d2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:05.614367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1178/2366] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:05.615702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc1a87-4957-462c-abb6-aebf53869b54 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:05.639639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc1a87-4957-462c-abb6-aebf53869b54 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:05.656129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:05.656755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.657160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.657658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.658506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:05.658909 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:05.664618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:05.699312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1189/2367] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:05.701062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb344ce5-a9f0-4359-9c07-538090d4d2c9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:05.718691 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb344ce5-a9f0-4359-9c07-538090d4d2c9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:05.727379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:05.728466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.735274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.736463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.737392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:05.741403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:05.824239 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1179/2368] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:38:05 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:05.828124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:05.843717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73da09c-7060-42eb-aab6-8bb18c3f4dc5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:05.914708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:05.916892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:05.919384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:05.960256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1931604-d53a-471c-bb1c-7ffe95eaa66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:05.962688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1931604-d53a-471c-bb1c-7ffe95eaa66e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:05.963246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1931604-d53a-471c-bb1c-7ffe95eaa66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:05.963696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1931604-d53a-471c-bb1c-7ffe95eaa66e admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:05.964517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1931604-d53a-471c-bb1c-7ffe95eaa66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:05.966837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1931604-d53a-471c-bb1c-7ffe95eaa66e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:06.010757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1190/2369] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:38:05 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:38:06.011720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1931604-d53a-471c-bb1c-7ffe95eaa66e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:06.038619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1931604-d53a-471c-bb1c-7ffe95eaa66e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:06.038795 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ba90-0a65-4661-a81b-23e54c5b463a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:06.043468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:06.044249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:06.044537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:06.044816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:06.052718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac78ab-26c1-48f2-ba16-d1d3305e6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:06.053535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac78ab-26c1-48f2-ba16-d1d3305e6fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:06.055053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac78ab-26c1-48f2-ba16-d1d3305e6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:06.055418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac78ab-26c1-48f2-ba16-d1d3305e6fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:06.056265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac78ab-26c1-48f2-ba16-d1d3305e6fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:06.060607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac78ab-26c1-48f2-ba16-d1d3305e6fd4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:06.081490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1191/2370] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:06.082642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac78ab-26c1-48f2-ba16-d1d3305e6fd4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:06.097846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac78ab-26c1-48f2-ba16-d1d3305e6fd4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:06.106739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2bf4b-98f8-4564-92c6-5496f6471bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:06.107429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2bf4b-98f8-4564-92c6-5496f6471bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:06.107713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2bf4b-98f8-4564-92c6-5496f6471bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:06.107994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2bf4b-98f8-4564-92c6-5496f6471bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:06.108725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2bf4b-98f8-4564-92c6-5496f6471bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:06.110378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2bf4b-98f8-4564-92c6-5496f6471bd7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:06.127781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1192/2371] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:06.131474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2bf4b-98f8-4564-92c6-5496f6471bd7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:06.144869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2bf4b-98f8-4564-92c6-5496f6471bd7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:06.152861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171730a4-7df9-4255-aeee-9c8d3e0791c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:06.153905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171730a4-7df9-4255-aeee-9c8d3e0791c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:06.154196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171730a4-7df9-4255-aeee-9c8d3e0791c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:06.154480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171730a4-7df9-4255-aeee-9c8d3e0791c7 admin admin] PATH_INFO: `/v3/projects/3f0a9656f1984462a3a10b5d4b74dd04/users/8eab82d35b6a4b02ae5fd84171edad20/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:06.163597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:06.166200 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:06.177101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1180/2372] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:06.191747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171730a4-7df9-4255-aeee-9c8d3e0791c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0a9656f1984462a3a10b5d4b74dd04, user_id=8eab82d35b6a4b02ae5fd84171edad20, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:06.191747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171730a4-7df9-4255-aeee-9c8d3e0791c7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:06.192116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:06.193510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:06.206117 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:06.211521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e75582-2f83-4130-9c28-edc7f05b3723 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:06.216616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1193/2373] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:38:06 2022] PUT /identity/v3/projects/3f0a9656f1984462a3a10b5d4b74dd04/users/8eab82d35b6a4b02ae5fd84171edad20/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:06.221883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2b8c7-5831-42cd-b1b8-216fc6e5c8e7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:06.222300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2b8c7-5831-42cd-b1b8-216fc6e5c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:06.222800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2b8c7-5831-42cd-b1b8-216fc6e5c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:06.284563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8ed2b8c7-5831-42cd-b1b8-216fc6e5c8e7 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:06.289389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8ed2b8c7-5831-42cd-b1b8-216fc6e5c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:06.326569 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:06.327754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:06.328194 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:06.328610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] PATH_INFO: `/v3/users/e2273a55456d45ea9c0f65943e09cbc2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:06.338977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2273a55456d45ea9c0f65943e09cbc2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:06.347333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:06.406266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1194/2374] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:06.420421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2b8c7-5831-42cd-b1b8-216fc6e5c8e7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:06.424684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8ed2b8c7-5831-42cd-b1b8-216fc6e5c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:06.494365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2273a55456d45ea9c0f65943e09cbc2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:06.591016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2273a55456d45ea9c0f65943e09cbc2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:06.592438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2273a55456d45ea9c0f65943e09cbc2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:06.594546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2b8c7-5831-42cd-b1b8-216fc6e5c8e7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:06.604553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:06.606164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:06.606463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:06.607333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:06.610616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:06.619144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2273a55456d45ea9c0f65943e09cbc2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:06.619804 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-76b7014b-49cf-4beb-a309-07b83cef458f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2273a55456d45ea9c0f65943e09cbc2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:06.631198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:06.632702 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:06.674596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1181/2375] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:06 2022] DELETE /identity/v3/users/e2273a55456d45ea9c0f65943e09cbc2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:06.680859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e47f-9682-430a-b102-58674d7baf6f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:06.681380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e47f-9682-430a-b102-58674d7baf6f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:06.681841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e47f-9682-430a-b102-58674d7baf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:06.688659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1195/2376] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:06.737701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4db9e47f-9682-430a-b102-58674d7baf6f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:06.739254 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4db9e47f-9682-430a-b102-58674d7baf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:06.827912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1182/2377] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:06.942574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:06.944277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:06.962787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd85028-73ef-45dd-9395-d9790d91e5b2 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:07.000172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:07.053344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a86d-c326-47ea-9788-48b320f1c281 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:07.053855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a86d-c326-47ea-9788-48b320f1c281 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:07.054272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a86d-c326-47ea-9788-48b320f1c281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:07.059090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:07.060459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:07.060699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:07.061056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:07.089233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9709a86d-c326-47ea-9788-48b320f1c281 None None] MFA Rules not processed for user `3ff6440aa1c54abe840dac4390335744`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:07.090057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:07.091686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:07.093115 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9709a86d-c326-47ea-9788-48b320f1c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:07.121766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1196/2378] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:07.141505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:07.233852 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1183/2379] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:08.496743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:08.498386 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:08.523040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685a8ad-3917-4862-ae74-09f2af047ee4 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:08.548123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:08.549297 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:08.549735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:08.550194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] PATH_INFO: `/v3/projects/bf70a6a1516a497489e3493bcbd85281` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:08.551560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf70a6a1516a497489e3493bcbd85281)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:08.553742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:08.663974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf70a6a1516a497489e3493bcbd85281', 'request_id': 'req-26274e48-a95e-421a-aaab-eb25ff2e00af'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:08.682315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf70a6a1516a497489e3493bcbd85281', 'request_id': 'req-26274e48-a95e-421a-aaab-eb25ff2e00af'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:08.697176 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf70a6a1516a497489e3493bcbd85281', 'request_id': 'req-26274e48-a95e-421a-aaab-eb25ff2e00af'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:08.725887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] The token cache is being invalidate because project bf70a6a1516a497489e3493bcbd85281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:08.726284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:08.727058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:08.742246 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1197/2380] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:08 2022] DELETE /identity/v3/projects/bf70a6a1516a497489e3493bcbd85281 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:09.417945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4496b-df26-4c3c-a0e8-02a78fb42f6b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:09.418818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4496b-df26-4c3c-a0e8-02a78fb42f6b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:09.419251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4496b-df26-4c3c-a0e8-02a78fb42f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:09.457879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5fc4496b-df26-4c3c-a0e8-02a78fb42f6b None None] MFA Rules not processed for user `8eab82d35b6a4b02ae5fd84171edad20`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:09.459559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5fc4496b-df26-4c3c-a0e8-02a78fb42f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:09.586161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1184/2381] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:09.597521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:09.601617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:09.716381 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274e48-a95e-421a-aaab-eb25ff2e00af admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:09.724522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:09.725658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:09.726197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:09.726616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:09.737389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:09.740240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:09.763755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1198/2382] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:10.243286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8b91c-4934-404e-82c8-765b27dc77e3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:10.243588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8b91c-4934-404e-82c8-765b27dc77e3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:10.243935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8b91c-4934-404e-82c8-765b27dc77e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:10.277093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-67e8b91c-4934-404e-82c8-765b27dc77e3 None None] MFA Rules not processed for user `f933db5569464bbcb6bbf0bb62359d33`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:10.278474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-67e8b91c-4934-404e-82c8-765b27dc77e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:10.358121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1185/2383] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:10.376492 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:10.378310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:10.475705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:10.539870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5aef4-2d18-4134-a163-775c34cf29da service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:10.560376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c11af-2e18-4d2b-b641-60e35b6f5cca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:10.561437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c11af-2e18-4d2b-b641-60e35b6f5cca service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:10.562999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c11af-2e18-4d2b-b641-60e35b6f5cca service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:10.564082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c11af-2e18-4d2b-b641-60e35b6f5cca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:10.582173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9d3c11af-2e18-4d2b-b641-60e35b6f5cca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:10.699526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c11af-2e18-4d2b-b641-60e35b6f5cca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:10.701535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c11af-2e18-4d2b-b641-60e35b6f5cca service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:10.743208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1199/2384] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:11.290974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a73a-e577-4e0d-8c24-519dcff643b2 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:11.291538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a73a-e577-4e0d-8c24-519dcff643b2 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:11.291701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a73a-e577-4e0d-8c24-519dcff643b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:11.321959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7920a73a-e577-4e0d-8c24-519dcff643b2 None None] MFA Rules not processed for user `8eab82d35b6a4b02ae5fd84171edad20`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:11.323259 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7920a73a-e577-4e0d-8c24-519dcff643b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:11.346280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1186/2385] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:12.929332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89c7d-7861-403d-8793-0f055d5f3007 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:12.930292 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89c7d-7861-403d-8793-0f055d5f3007 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:12.930403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab89c7d-7861-403d-8793-0f055d5f3007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:12.960528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6ab89c7d-7861-403d-8793-0f055d5f3007 None None] MFA Rules not processed for user `b8e78886edbc4ee8aaf4efc77e0316f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:12.962380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6ab89c7d-7861-403d-8793-0f055d5f3007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:12.981485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1200/2386] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:17.564238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920a73a-e577-4e0d-8c24-519dcff643b2 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:17.566307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7920a73a-e577-4e0d-8c24-519dcff643b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:17.613551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:17.638358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920a73a-e577-4e0d-8c24-519dcff643b2 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:17.642906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:17.643785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.644071 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.644349 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] PATH_INFO: `/v3/users/680b1ddd26124fae932942ec3f44c1c8` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.646081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=680b1ddd26124fae932942ec3f44c1c8)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:17.648017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:17.694540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680b1ddd26124fae932942ec3f44c1c8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.706024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680b1ddd26124fae932942ec3f44c1c8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.706693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680b1ddd26124fae932942ec3f44c1c8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.714553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680b1ddd26124fae932942ec3f44c1c8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.715213 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680b1ddd26124fae932942ec3f44c1c8'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:17.729063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1187/2387] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:17 2022] DELETE /identity/v3/users/680b1ddd26124fae932942ec3f44c1c8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:17.901794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab89c7d-7861-403d-8793-0f055d5f3007 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:17.913258 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab89c7d-7861-403d-8793-0f055d5f3007 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:17.971614 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:17.972505 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:17.972791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:17.973097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] PATH_INFO: `/v3/projects/7d696eb8cb2145ae8b284e6668cffd0f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:17.974312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d696eb8cb2145ae8b284e6668cffd0f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:17.976263 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.022956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d696eb8cb2145ae8b284e6668cffd0f', 'request_id': 'req-c89662ae-bc33-4bab-b2d2-47ee284f03dd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.028601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d696eb8cb2145ae8b284e6668cffd0f', 'request_id': 'req-c89662ae-bc33-4bab-b2d2-47ee284f03dd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.035049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d696eb8cb2145ae8b284e6668cffd0f', 'request_id': 'req-c89662ae-bc33-4bab-b2d2-47ee284f03dd'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.048611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] The token cache is being invalidate because project 7d696eb8cb2145ae8b284e6668cffd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:18.048996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.049627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.051479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1201/2388] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:17 2022] DELETE /identity/v3/projects/7d696eb8cb2145ae8b284e6668cffd0f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:38:18.055334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.056779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.070340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25160ca-7a6e-44f1-b224-1eea38e6bf9d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.138646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.141810 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.142098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.142379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] PATH_INFO: `/v3/users/9a4c12cdb4df40bfbaca69da46130ef3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.143623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4c12cdb4df40bfbaca69da46130ef3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.145782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.199642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4c12cdb4df40bfbaca69da46130ef3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.207317 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:18.215324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4c12cdb4df40bfbaca69da46130ef3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.218242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4c12cdb4df40bfbaca69da46130ef3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.225853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4c12cdb4df40bfbaca69da46130ef3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.226536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b87df2f0-6191-4d6b-8c7e-250043aeed70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4c12cdb4df40bfbaca69da46130ef3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.241421 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1188/2389] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:18 2022] DELETE /identity/v3/users/9a4c12cdb4df40bfbaca69da46130ef3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:18.424671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.429171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.446302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89662ae-bc33-4bab-b2d2-47ee284f03dd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.460017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:18.539911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.541263 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.541608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.541923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] PATH_INFO: `/v3/projects/68ccba190b6c49c7a505092b1ecb46c4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.543280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ccba190b6c49c7a505092b1ecb46c4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.545441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.606952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ccba190b6c49c7a505092b1ecb46c4', 'request_id': 'req-cb4b2872-4872-458c-b05d-e807b27be22d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.614693 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ccba190b6c49c7a505092b1ecb46c4', 'request_id': 'req-cb4b2872-4872-458c-b05d-e807b27be22d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.623172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ccba190b6c49c7a505092b1ecb46c4', 'request_id': 'req-cb4b2872-4872-458c-b05d-e807b27be22d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.646848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] The token cache is being invalidate because project 68ccba190b6c49c7a505092b1ecb46c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:18.647241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.653328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cb4b2872-4872-458c-b05d-e807b27be22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:18.655223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1202/2390] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:18 2022] DELETE /identity/v3/projects/68ccba190b6c49c7a505092b1ecb46c4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:18.661486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e22b-3380-48b8-85b7-1f8f86508adc None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.661985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e22b-3380-48b8-85b7-1f8f86508adc None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.662077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e22b-3380-48b8-85b7-1f8f86508adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.681858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a9f4e22b-3380-48b8-85b7-1f8f86508adc None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:18.683360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a9f4e22b-3380-48b8-85b7-1f8f86508adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.767624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1189/2391] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:18.770096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6f1b-8b13-4518-b50e-b89037b8b1d0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.770587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6f1b-8b13-4518-b50e-b89037b8b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.771052 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6f1b-8b13-4518-b50e-b89037b8b1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.791097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1a6d6f1b-8b13-4518-b50e-b89037b8b1d0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:18.792501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1a6d6f1b-8b13-4518-b50e-b89037b8b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:18.807709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1203/2392] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:18.811977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4e22b-3380-48b8-85b7-1f8f86508adc None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.822098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4e22b-3380-48b8-85b7-1f8f86508adc None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.827216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.827990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.828346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.828773 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.829774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:18.829916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.831600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.853160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1190/2393] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:18.854343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d6f1b-8b13-4518-b50e-b89037b8b1d0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.866217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d6f1b-8b13-4518-b50e-b89037b8b1d0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:18.871303 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520a31d-fc53-4bda-9623-0499c4bc9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:18.872068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520a31d-fc53-4bda-9623-0499c4bc9123 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:18.873004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520a31d-fc53-4bda-9623-0499c4bc9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:18.873362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520a31d-fc53-4bda-9623-0499c4bc9123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:18.874154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520a31d-fc53-4bda-9623-0499c4bc9123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:18.877691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520a31d-fc53-4bda-9623-0499c4bc9123 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:18.937250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1204/2394] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:18.939292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:18.959819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86dc5f-469f-48d4-adea-28433d382d90 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.044694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f46d1-1f46-4df6-97d6-0b813d3d2047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.045484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f46d1-1f46-4df6-97d6-0b813d3d2047 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.045775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f46d1-1f46-4df6-97d6-0b813d3d2047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.046058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f46d1-1f46-4df6-97d6-0b813d3d2047 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.046757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f46d1-1f46-4df6-97d6-0b813d3d2047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.048808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f46d1-1f46-4df6-97d6-0b813d3d2047 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.088652 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1191/2395] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:38:18 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:19.092814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520a31d-fc53-4bda-9623-0499c4bc9123 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.104709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520a31d-fc53-4bda-9623-0499c4bc9123 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.110493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65b4eb-7905-48ab-b118-5ebe6d53720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.111184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65b4eb-7905-48ab-b118-5ebe6d53720e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.111600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65b4eb-7905-48ab-b118-5ebe6d53720e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.111855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65b4eb-7905-48ab-b118-5ebe6d53720e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.112573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65b4eb-7905-48ab-b118-5ebe6d53720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.114294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65b4eb-7905-48ab-b118-5ebe6d53720e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.125715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1205/2396] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:38:19.129656 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f46d1-1f46-4df6-97d6-0b813d3d2047 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.143242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f46d1-1f46-4df6-97d6-0b813d3d2047 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.150752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0cf58-3c36-490d-85e3-55b9d174b231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.151582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0cf58-3c36-490d-85e3-55b9d174b231 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.151817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0cf58-3c36-490d-85e3-55b9d174b231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.152132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0cf58-3c36-490d-85e3-55b9d174b231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.152881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0cf58-3c36-490d-85e3-55b9d174b231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.156087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0cf58-3c36-490d-85e3-55b9d174b231 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.168056 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1192/2397] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:19.172446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65b4eb-7905-48ab-b118-5ebe6d53720e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.184398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65b4eb-7905-48ab-b118-5ebe6d53720e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.189335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.190310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.190599 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.190877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] PATH_INFO: `/v3/projects/0383889df7154ae38a266db1c0594a74/users/a9136921372543bb81260ffca7072764/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.206934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0383889df7154ae38a266db1c0594a74, user_id=a9136921372543bb81260ffca7072764, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.210285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.225584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1206/2398] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:38:19 2022] PUT /identity/v3/projects/0383889df7154ae38a266db1c0594a74/users/a9136921372543bb81260ffca7072764/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:19.235799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7b53-efe6-4337-9b8e-68b94ebea0b0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.236089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7b53-efe6-4337-9b8e-68b94ebea0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.236370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7b53-efe6-4337-9b8e-68b94ebea0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.266462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bbaa7b53-efe6-4337-9b8e-68b94ebea0b0 None None] MFA Rules not processed for user `a9136921372543bb81260ffca7072764`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:19.267679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bbaa7b53-efe6-4337-9b8e-68b94ebea0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:19.313538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:19.362596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1193/2399] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:19.371830 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.373760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:19.432713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:19.453605 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6eff-20af-4594-8455-173870f24e96 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.464951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145702ad-35f9-4c45-90e8-938e821286bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.464951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145702ad-35f9-4c45-90e8-938e821286bc service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.464951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145702ad-35f9-4c45-90e8-938e821286bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.464951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145702ad-35f9-4c45-90e8-938e821286bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.473521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145702ad-35f9-4c45-90e8-938e821286bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.475123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145702ad-35f9-4c45-90e8-938e821286bc service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.484581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1207/2400] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:19.689300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7b53-efe6-4337-9b8e-68b94ebea0b0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.691569 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bbaa7b53-efe6-4337-9b8e-68b94ebea0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:19.784061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7b53-efe6-4337-9b8e-68b94ebea0b0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:19.792271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:19.793097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.793453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.793801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] PATH_INFO: `/v3/users/ea2de49e762a41e883f9787c4edcb9ba` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.795384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2de49e762a41e883f9787c4edcb9ba)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:19.797588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:19.855508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2de49e762a41e883f9787c4edcb9ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:19.869260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2de49e762a41e883f9787c4edcb9ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:19.869959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2de49e762a41e883f9787c4edcb9ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:19.877128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2de49e762a41e883f9787c4edcb9ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:19.877744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2de49e762a41e883f9787c4edcb9ba'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:19.891580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1194/2401] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:19 2022] DELETE /identity/v3/users/ea2de49e762a41e883f9787c4edcb9ba => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:19.896119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07680ca0-2ea2-4804-b3e5-a39008545acb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:19.896431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07680ca0-2ea2-4804-b3e5-a39008545acb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:19.896712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07680ca0-2ea2-4804-b3e5-a39008545acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:19.915413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-07680ca0-2ea2-4804-b3e5-a39008545acb None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:19.916554 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-07680ca0-2ea2-4804-b3e5-a39008545acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:19.974320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1208/2402] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:19.983845 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:19.985357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:20.049226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2097e5-7611-46b7-8c9e-1eeaada38e92 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.053671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cffdcf-d8ce-41cc-81a3-4c7e7068cb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.054325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cffdcf-d8ce-41cc-81a3-4c7e7068cb27 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.054609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cffdcf-d8ce-41cc-81a3-4c7e7068cb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.054887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cffdcf-d8ce-41cc-81a3-4c7e7068cb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.061211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:20.067725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cffdcf-d8ce-41cc-81a3-4c7e7068cb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.068102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cffdcf-d8ce-41cc-81a3-4c7e7068cb27 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.080087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1195/2403] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:20.359842 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07680ca0-2ea2-4804-b3e5-a39008545acb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.361592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-07680ca0-2ea2-4804-b3e5-a39008545acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:20.376136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07680ca0-2ea2-4804-b3e5-a39008545acb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.382099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.385520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.385853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.386083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] PATH_INFO: `/v3/projects/1c4696d3a0b7476aaece25e0a151d4f6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.387675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4696d3a0b7476aaece25e0a151d4f6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.389519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.436023 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4696d3a0b7476aaece25e0a151d4f6', 'request_id': 'req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:20.441829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4696d3a0b7476aaece25e0a151d4f6', 'request_id': 'req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:20.449005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4696d3a0b7476aaece25e0a151d4f6', 'request_id': 'req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:20.462369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] The token cache is being invalidate because project 1c4696d3a0b7476aaece25e0a151d4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:20.462659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:20.463275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f1230be3-0ff2-487f-b1c1-23b6ae8a82dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:20.464937 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1209/2404] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:20 2022] DELETE /identity/v3/projects/1c4696d3a0b7476aaece25e0a151d4f6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:20.470476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9794-9397-42b5-ba43-977e7f507677 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.470796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9794-9397-42b5-ba43-977e7f507677 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.471153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9794-9397-42b5-ba43-977e7f507677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.490169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d6fa9794-9397-42b5-ba43-977e7f507677 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:20.491401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d6fa9794-9397-42b5-ba43-977e7f507677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:20.553958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1196/2405] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:20.561298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7c553-47a1-4e94-9e56-67d935835aae None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.561600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7c553-47a1-4e94-9e56-67d935835aae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.561863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7c553-47a1-4e94-9e56-67d935835aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.581616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e2b7c553-47a1-4e94-9e56-67d935835aae None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:20.582843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e2b7c553-47a1-4e94-9e56-67d935835aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:20.590777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1210/2406] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:20.595209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9794-9397-42b5-ba43-977e7f507677 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.605444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9794-9397-42b5-ba43-977e7f507677 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.611655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.612883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.613395 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.614444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.615842 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:20.616420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.619549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.640039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1197/2407] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:20.644459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7c553-47a1-4e94-9e56-67d935835aae None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.654306 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7c553-47a1-4e94-9e56-67d935835aae None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.658980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d3312-c4e9-407c-b735-ba9cc313a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.659630 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3312-c4e9-407c-b735-ba9cc313a961 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.659911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3312-c4e9-407c-b735-ba9cc313a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.660189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3312-c4e9-407c-b735-ba9cc313a961 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.660939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d3312-c4e9-407c-b735-ba9cc313a961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.662929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d3312-c4e9-407c-b735-ba9cc313a961 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.689778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1211/2408] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:38:20 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:20.694683 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.704983 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe085e-4d85-4cef-82e2-a571fafb0e07 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.772924 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56550b-107b-495f-b018-6c9b66e03697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.773888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56550b-107b-495f-b018-6c9b66e03697 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.774172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56550b-107b-495f-b018-6c9b66e03697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.774449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56550b-107b-495f-b018-6c9b66e03697 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.775155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56550b-107b-495f-b018-6c9b66e03697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.777095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56550b-107b-495f-b018-6c9b66e03697 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.801313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1198/2409] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:38:20 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:20.805858 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d3312-c4e9-407c-b735-ba9cc313a961 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.817300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d3312-c4e9-407c-b735-ba9cc313a961 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.822366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d6d4-9d28-4df5-a7fb-6210e5a6f05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.823035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d6d4-9d28-4df5-a7fb-6210e5a6f05c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.823455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d6d4-9d28-4df5-a7fb-6210e5a6f05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.823872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d6d4-9d28-4df5-a7fb-6210e5a6f05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.825933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3d6d4-9d28-4df5-a7fb-6210e5a6f05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.829319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3d6d4-9d28-4df5-a7fb-6210e5a6f05c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.840660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1212/2410] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:20.845269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56550b-107b-495f-b018-6c9b66e03697 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.860867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56550b-107b-495f-b018-6c9b66e03697 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.867565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed849c-b370-4794-ac8c-6e4e1711d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.868267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed849c-b370-4794-ac8c-6e4e1711d2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.868559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed849c-b370-4794-ac8c-6e4e1711d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.868980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed849c-b370-4794-ac8c-6e4e1711d2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.869784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed849c-b370-4794-ac8c-6e4e1711d2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.871545 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed849c-b370-4794-ac8c-6e4e1711d2e4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.888483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1199/2411] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:20.890896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8b0b-7190-4597-8837-6c625745007d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.891189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8b0b-7190-4597-8837-6c625745007d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.891627 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8b0b-7190-4597-8837-6c625745007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.898825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed849c-b370-4794-ac8c-6e4e1711d2e4 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:20.910239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c59b8b0b-7190-4597-8837-6c625745007d None None] MFA Rules not processed for user `a9136921372543bb81260ffca7072764`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:20.912057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c59b8b0b-7190-4597-8837-6c625745007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:20.919460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed849c-b370-4794-ac8c-6e4e1711d2e4 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:20.934372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:20.937014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce572422-ab33-4e89-9228-25c627560a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:20.938165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572422-ab33-4e89-9228-25c627560a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.938554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572422-ab33-4e89-9228-25c627560a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.938887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572422-ab33-4e89-9228-25c627560a0d admin admin] PATH_INFO: `/v3/projects/9702d66b620245749ef4c21886ba6914/users/b5e855b5020d4fe295977c739a59a9a3/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:20.958052 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce572422-ab33-4e89-9228-25c627560a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9702d66b620245749ef4c21886ba6914, user_id=b5e855b5020d4fe295977c739a59a9a3, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:20.961336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce572422-ab33-4e89-9228-25c627560a0d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:20.989693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1200/2412] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:38:20 2022] PUT /identity/v3/projects/9702d66b620245749ef4c21886ba6914/users/b5e855b5020d4fe295977c739a59a9a3/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:20.989931 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1213/2413] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:20.994456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f987f-5aa3-47af-be75-bfbb6c9c0d22 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:20.995088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f987f-5aa3-47af-be75-bfbb6c9c0d22 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:20.995590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f987f-5aa3-47af-be75-bfbb6c9c0d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:21.050014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-625f987f-5aa3-47af-be75-bfbb6c9c0d22 None None] MFA Rules not processed for user `b5e855b5020d4fe295977c739a59a9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:21.051360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-625f987f-5aa3-47af-be75-bfbb6c9c0d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:21.081544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:21.129237 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1201/2414] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:21.140182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b8b0b-7190-4597-8837-6c625745007d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:21.141644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c59b8b0b-7190-4597-8837-6c625745007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:21.209736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b8b0b-7190-4597-8837-6c625745007d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:21.284075 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d8f1b-5649-4d6d-9098-e154d63ac639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:21.285151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d8f1b-5649-4d6d-9098-e154d63ac639 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:21.285595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d8f1b-5649-4d6d-9098-e154d63ac639 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:21.286617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d8f1b-5649-4d6d-9098-e154d63ac639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:21.306406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d8f1b-5649-4d6d-9098-e154d63ac639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:21.309107 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d8f1b-5649-4d6d-9098-e154d63ac639 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:21.321514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1214/2415] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:28.935505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762c92-6ab5-4d4d-a608-43c5e26982f6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:28.936312 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762c92-6ab5-4d4d-a608-43c5e26982f6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:28.936312 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762c92-6ab5-4d4d-a608-43c5e26982f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:28.979706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7d762c92-6ab5-4d4d-a608-43c5e26982f6 None None] MFA Rules not processed for user `1a3ca370feb4457dbadc476e348ac9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:28.981014 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7d762c92-6ab5-4d4d-a608-43c5e26982f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:29.069097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1202/2416] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:29.667796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1069730-010d-4c59-972d-44485d7c4aa8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:29.668256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1069730-010d-4c59-972d-44485d7c4aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:29.669929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1069730-010d-4c59-972d-44485d7c4aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:29.707076 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e1069730-010d-4c59-972d-44485d7c4aa8 None None] MFA Rules not processed for user `3ff6440aa1c54abe840dac4390335744`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:29.708493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e1069730-010d-4c59-972d-44485d7c4aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:29.826890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1215/2417] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:32.039041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d762c92-6ab5-4d4d-a608-43c5e26982f6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:32.193742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d762c92-6ab5-4d4d-a608-43c5e26982f6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:32.198817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:32.199693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.199978 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.200257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] PATH_INFO: `/v3/users/b5e855b5020d4fe295977c739a59a9a3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.202616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e855b5020d4fe295977c739a59a9a3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:32.204567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:32.289961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:32.348659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e855b5020d4fe295977c739a59a9a3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.380598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e855b5020d4fe295977c739a59a9a3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.381536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e855b5020d4fe295977c739a59a9a3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.397055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e855b5020d4fe295977c739a59a9a3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.397979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e855b5020d4fe295977c739a59a9a3'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:32.424500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1203/2418] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:32 2022] DELETE /identity/v3/users/b5e855b5020d4fe295977c739a59a9a3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:32.429754 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5aa2-41f5-4df3-89e6-e04658ad24fa None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.430310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5aa2-41f5-4df3-89e6-e04658ad24fa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.430310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a5aa2-41f5-4df3-89e6-e04658ad24fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.493267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-478a5aa2-41f5-4df3-89e6-e04658ad24fa None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:32.494729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-478a5aa2-41f5-4df3-89e6-e04658ad24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:32.509247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:32.582425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1216/2419] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:32.597044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:32.598493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:32.739249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d7338-6614-41bf-a9cb-3ff7e02671d7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:32.744928 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a172f4c-3f7c-4176-9b90-57d62683a8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:32.745520 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172f4c-3f7c-4176-9b90-57d62683a8ad service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:32.745804 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172f4c-3f7c-4176-9b90-57d62683a8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:32.746084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172f4c-3f7c-4176-9b90-57d62683a8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:32.757367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a172f4c-3f7c-4176-9b90-57d62683a8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:32.758839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a172f4c-3f7c-4176-9b90-57d62683a8ad service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:32.772419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1204/2420] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:33.208737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a5aa2-41f5-4df3-89e6-e04658ad24fa None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:33.210057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-478a5aa2-41f5-4df3-89e6-e04658ad24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:33.222936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a5aa2-41f5-4df3-89e6-e04658ad24fa None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:33.228441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:33.229331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:33.229659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:33.229869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] PATH_INFO: `/v3/projects/9702d66b620245749ef4c21886ba6914` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:33.231119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9702d66b620245749ef4c21886ba6914)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:33.232984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:33.283974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9702d66b620245749ef4c21886ba6914', 'request_id': 'req-32f005da-d163-4165-ba2e-8f2f9a18fb14'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:33.291498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9702d66b620245749ef4c21886ba6914', 'request_id': 'req-32f005da-d163-4165-ba2e-8f2f9a18fb14'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:33.300862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9702d66b620245749ef4c21886ba6914', 'request_id': 'req-32f005da-d163-4165-ba2e-8f2f9a18fb14'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:33.318871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] The token cache is being invalidate because project 9702d66b620245749ef4c21886ba6914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:33.319366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:33.321285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-32f005da-d163-4165-ba2e-8f2f9a18fb14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:33.323138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1217/2421] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:33 2022] DELETE /identity/v3/projects/9702d66b620245749ef4c21886ba6914 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:41.222197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ba7d-999f-4e07-90d8-b0e2b010c990 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:41.222710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ba7d-999f-4e07-90d8-b0e2b010c990 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:41.222814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ba7d-999f-4e07-90d8-b0e2b010c990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:41.239360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4b60ba7d-999f-4e07-90d8-b0e2b010c990 None None] MFA Rules not processed for user `43d9ae4fd922444e9f70fe79d4cacb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:41.241109 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4b60ba7d-999f-4e07-90d8-b0e2b010c990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:41.301001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1205/2422] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:43.314942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:49.541716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45517-3bb8-4071-8c53-780733a80cae None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.542287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45517-3bb8-4071-8c53-780733a80cae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.542287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45517-3bb8-4071-8c53-780733a80cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.572398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d4f45517-3bb8-4071-8c53-780733a80cae None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:49.573684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d4f45517-3bb8-4071-8c53-780733a80cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:49.641252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1218/2423] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:49.686811 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ba7d-999f-4e07-90d8-b0e2b010c990 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.688331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4b60ba7d-999f-4e07-90d8-b0e2b010c990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:49.706715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:49.796768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ba7d-999f-4e07-90d8-b0e2b010c990 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.803020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd6fc-b5a4-46e4-9ece-86e9ef646b9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.804360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd6fc-b5a4-46e4-9ece-86e9ef646b9a service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.804648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd6fc-b5a4-46e4-9ece-86e9ef646b9a service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.804966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd6fc-b5a4-46e4-9ece-86e9ef646b9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.817102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bd6fc-b5a4-46e4-9ece-86e9ef646b9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.820211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bd6fc-b5a4-46e4-9ece-86e9ef646b9a service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.830517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1206/2424] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:38:50.471738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73b89d-d052-4c26-984f-d9b39787af8b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.472028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73b89d-d052-4c26-984f-d9b39787af8b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.472307 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73b89d-d052-4c26-984f-d9b39787af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.489929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ad73b89d-d052-4c26-984f-d9b39787af8b None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:50.491116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ad73b89d-d052-4c26-984f-d9b39787af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:50.498167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1219/2425] 10.222.0.79 () {58 vars in 967 bytes} [Fri May 27 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:50.511222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd6fc-b5a4-46e4-9ece-86e9ef646b9a service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.522700 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd6fc-b5a4-46e4-9ece-86e9ef646b9a service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.527731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5df4fd-201d-4264-a945-23e6db53a001 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.528377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5df4fd-201d-4264-a945-23e6db53a001 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.528662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5df4fd-201d-4264-a945-23e6db53a001 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.528966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5df4fd-201d-4264-a945-23e6db53a001 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.537131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5df4fd-201d-4264-a945-23e6db53a001 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.538760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5df4fd-201d-4264-a945-23e6db53a001 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.547781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1207/2426] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:38:50.748580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd92fc-0398-4a41-bf7b-727d71cf43b3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.749064 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd92fc-0398-4a41-bf7b-727d71cf43b3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.749178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd92fc-0398-4a41-bf7b-727d71cf43b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.766919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8fbd92fc-0398-4a41-bf7b-727d71cf43b3 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:50.768088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8fbd92fc-0398-4a41-bf7b-727d71cf43b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:50.775215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1220/2427] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:50.787432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5df4fd-201d-4264-a945-23e6db53a001 service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.797855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5df4fd-201d-4264-a945-23e6db53a001 service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.803880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a434-a3af-40b4-93c6-789a658d1e40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.804695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a434-a3af-40b4-93c6-789a658d1e40 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.805197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a434-a3af-40b4-93c6-789a658d1e40 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.805484 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3a434-a3af-40b4-93c6-789a658d1e40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.814040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3a434-a3af-40b4-93c6-789a658d1e40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.815655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3a434-a3af-40b4-93c6-789a658d1e40 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.824310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1208/2428] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:38:51.185928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056680b0-ffe9-42ba-a553-551491c87eaf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:51.186517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056680b0-ffe9-42ba-a553-551491c87eaf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:51.186856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056680b0-ffe9-42ba-a553-551491c87eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:51.206481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-056680b0-ffe9-42ba-a553-551491c87eaf None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:51.207808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-056680b0-ffe9-42ba-a553-551491c87eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:51.225592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1221/2429] 10.222.0.79 () {58 vars in 967 bytes} [Fri May 27 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:51.243522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a434-a3af-40b4-93c6-789a658d1e40 service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:51.255077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3a434-a3af-40b4-93c6-789a658d1e40 service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:51.261893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d398751-ba59-4b34-b19d-18f42b0ece3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:51.262564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398751-ba59-4b34-b19d-18f42b0ece3e service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:51.262848 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398751-ba59-4b34-b19d-18f42b0ece3e service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:51.263125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398751-ba59-4b34-b19d-18f42b0ece3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:51.273788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398751-ba59-4b34-b19d-18f42b0ece3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:51.276396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398751-ba59-4b34-b19d-18f42b0ece3e service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:51.285264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1209/2430] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:38:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:38:53.365208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056680b0-ffe9-42ba-a553-551491c87eaf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:53.366656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-056680b0-ffe9-42ba-a553-551491c87eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:53.433200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056680b0-ffe9-42ba-a553-551491c87eaf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:53.437710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:53.438580 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:53.438875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:53.439152 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] PATH_INFO: `/v3/users/a9136921372543bb81260ffca7072764` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:53.440343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9136921372543bb81260ffca7072764)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:53.442310 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:53.488250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9136921372543bb81260ffca7072764'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:53.500429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9136921372543bb81260ffca7072764'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:53.508620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9136921372543bb81260ffca7072764'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:53.509328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9136921372543bb81260ffca7072764'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:53.509941 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9136921372543bb81260ffca7072764'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:53.511354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:53.526867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1222/2431] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:38:53 2022] DELETE /identity/v3/users/a9136921372543bb81260ffca7072764 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:53.530931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f526-a0a1-467b-aef5-707481b31837 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:53.531413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f526-a0a1-467b-aef5-707481b31837 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:53.531519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f526-a0a1-467b-aef5-707481b31837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:53.551093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1d58f526-a0a1-467b-aef5-707481b31837 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:53.553130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1d58f526-a0a1-467b-aef5-707481b31837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:53.622030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1210/2432] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:53.632771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:53.634223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:53.692928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be918c6-0aa2-427a-8175-1cfc729a269d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:53.698442 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144aea1-91cb-4af8-93bb-4ea5dc63b019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:53.699106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144aea1-91cb-4af8-93bb-4ea5dc63b019 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:53.699391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144aea1-91cb-4af8-93bb-4ea5dc63b019 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:53.699674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144aea1-91cb-4af8-93bb-4ea5dc63b019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:53.710906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144aea1-91cb-4af8-93bb-4ea5dc63b019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:53.712983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144aea1-91cb-4af8-93bb-4ea5dc63b019 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:53.733401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1223/2433] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:54.042881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58f526-a0a1-467b-aef5-707481b31837 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.044601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1d58f526-a0a1-467b-aef5-707481b31837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:54.063636 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58f526-a0a1-467b-aef5-707481b31837 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.077131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.078390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.078878 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.079788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] PATH_INFO: `/v3/projects/0383889df7154ae38a266db1c0594a74` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.093688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0383889df7154ae38a266db1c0594a74)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.095742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.171229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0383889df7154ae38a266db1c0594a74', 'request_id': 'req-b8c35528-cd39-4bbe-ba60-01c988641aa2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.179471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0383889df7154ae38a266db1c0594a74', 'request_id': 'req-b8c35528-cd39-4bbe-ba60-01c988641aa2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.182556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:54.190400 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0383889df7154ae38a266db1c0594a74', 'request_id': 'req-b8c35528-cd39-4bbe-ba60-01c988641aa2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.213311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] The token cache is being invalidate because project 0383889df7154ae38a266db1c0594a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:54.213616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.225944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.242474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1211/2434] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:38:54 2022] DELETE /identity/v3/projects/0383889df7154ae38a266db1c0594a74 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:55.448740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7934-7d25-43ab-8622-7183ddd04016 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.449354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7934-7d25-43ab-8622-7183ddd04016 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.450149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7934-7d25-43ab-8622-7183ddd04016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.517964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8cea7934-7d25-43ab-8622-7183ddd04016 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:55.519254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8cea7934-7d25-43ab-8622-7183ddd04016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:55.579732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1224/2435] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:55.603137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:55.604534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:55.698489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c35528-cd39-4bbe-ba60-01c988641aa2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:55.704164 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84700e-73ee-4de4-be6e-01595217b056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:55.704776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84700e-73ee-4de4-be6e-01595217b056 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.705089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84700e-73ee-4de4-be6e-01595217b056 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.705371 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84700e-73ee-4de4-be6e-01595217b056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.714331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84700e-73ee-4de4-be6e-01595217b056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:55.715856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84700e-73ee-4de4-be6e-01595217b056 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:55.725867 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1212/2436] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:58.051270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea7934-7d25-43ab-8622-7183ddd04016 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:58.053707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8cea7934-7d25-43ab-8622-7183ddd04016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:58.107851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea7934-7d25-43ab-8622-7183ddd04016 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:58.111704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323a788-a390-4d83-9eb0-dcd1309874ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:58.112276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a788-a390-4d83-9eb0-dcd1309874ab service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:58.112557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a788-a390-4d83-9eb0-dcd1309874ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:58.112848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a788-a390-4d83-9eb0-dcd1309874ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:58.115251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0323a788-a390-4d83-9eb0-dcd1309874ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:58.135929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:58.177869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323a788-a390-4d83-9eb0-dcd1309874ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:58.179313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323a788-a390-4d83-9eb0-dcd1309874ab service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:58.188755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1225/2437] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:38:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:00.628069 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5fe4-7651-4c3d-9a43-64cc5739dcfd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:00.629463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5fe4-7651-4c3d-9a43-64cc5739dcfd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:00.631084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5fe4-7651-4c3d-9a43-64cc5739dcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:00.659119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-19cb5fe4-7651-4c3d-9a43-64cc5739dcfd None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:00.660352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-19cb5fe4-7651-4c3d-9a43-64cc5739dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:00.682346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d421-6e81-4b28-a516-cd727680a026 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:00.683972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d421-6e81-4b28-a516-cd727680a026 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:00.684490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d421-6e81-4b28-a516-cd727680a026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:00.712887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9d65d421-6e81-4b28-a516-cd727680a026 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:00.714644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9d65d421-6e81-4b28-a516-cd727680a026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:00.735981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1226/2438] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:00.743888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1213/2439] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:00.757259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65d421-6e81-4b28-a516-cd727680a026 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:00.759049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb5fe4-7651-4c3d-9a43-64cc5739dcfd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:00.759221 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9d65d421-6e81-4b28-a516-cd727680a026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:00.779196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb5fe4-7651-4c3d-9a43-64cc5739dcfd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:00.790128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd15873-e153-404c-976c-5a0fecdfb0e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:00.791174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd15873-e153-404c-976c-5a0fecdfb0e2 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:00.791671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd15873-e153-404c-976c-5a0fecdfb0e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:00.792193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd15873-e153-404c-976c-5a0fecdfb0e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:00.802351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd15873-e153-404c-976c-5a0fecdfb0e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:00.804062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd15873-e153-404c-976c-5a0fecdfb0e2 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:00.815046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1214/2440] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:00.856886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65d421-6e81-4b28-a516-cd727680a026 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:00.862148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:00.862799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:00.863083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:00.863387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:00.872415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:00.874062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:00.885311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1227/2441] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:39:03.992283 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d970-73dd-489f-8a8e-abac5632c42b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.993357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d970-73dd-489f-8a8e-abac5632c42b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.993652 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9d970-73dd-489f-8a8e-abac5632c42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:04.016027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-41c9d970-73dd-489f-8a8e-abac5632c42b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:04.017365 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-41c9d970-73dd-489f-8a8e-abac5632c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:04.026662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1215/2442] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:04.049663 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:04.051217 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:04.068032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ac33f-911b-44cd-959b-cb5d36975f96 service swift] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:04.073685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d881-adf9-453e-8e8d-ab76da7c4ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:04.074337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d881-adf9-453e-8e8d-ab76da7c4ce5 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:04.074618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d881-adf9-453e-8e8d-ab76da7c4ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:04.075071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3d881-adf9-453e-8e8d-ab76da7c4ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:04.086916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3d881-adf9-453e-8e8d-ab76da7c4ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:04.089127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3d881-adf9-453e-8e8d-ab76da7c4ce5 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:04.108735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1228/2443] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:08.151403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a68b-7678-4ea8-8b8e-08b4ecfde30f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:08.152059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a68b-7678-4ea8-8b8e-08b4ecfde30f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:08.152059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a68b-7678-4ea8-8b8e-08b4ecfde30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:08.189282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ab91a68b-7678-4ea8-8b8e-08b4ecfde30f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:08.190526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ab91a68b-7678-4ea8-8b8e-08b4ecfde30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:08.210559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1216/2444] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:08.240780 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d881-adf9-453e-8e8d-ab76da7c4ce5 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:08.257889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3d881-adf9-453e-8e8d-ab76da7c4ce5 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:08.268848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807e3bf-0b9a-47c1-981b-c27fbd006a87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:08.269843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e3bf-0b9a-47c1-981b-c27fbd006a87 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:08.271120 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e3bf-0b9a-47c1-981b-c27fbd006a87 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:08.272639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e3bf-0b9a-47c1-981b-c27fbd006a87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:08.290538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807e3bf-0b9a-47c1-981b-c27fbd006a87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:08.292466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807e3bf-0b9a-47c1-981b-c27fbd006a87 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:08.309056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1229/2445] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:12.443161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7d74-5c87-4ef5-94fa-7a1b21336916 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:12.443763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7d74-5c87-4ef5-94fa-7a1b21336916 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:12.443882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7d74-5c87-4ef5-94fa-7a1b21336916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:12.463982 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-46cd7d74-5c87-4ef5-94fa-7a1b21336916 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:12.465267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-46cd7d74-5c87-4ef5-94fa-7a1b21336916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:12.473865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1217/2446] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:12.499345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807e3bf-0b9a-47c1-981b-c27fbd006a87 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:12.512861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807e3bf-0b9a-47c1-981b-c27fbd006a87 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:12.524718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90031296-299d-4c42-b6bf-b3b3ced81dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:12.525459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031296-299d-4c42-b6bf-b3b3ced81dd9 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:12.525739 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031296-299d-4c42-b6bf-b3b3ced81dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:12.526021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031296-299d-4c42-b6bf-b3b3ced81dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:12.539321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90031296-299d-4c42-b6bf-b3b3ced81dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:12.550680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90031296-299d-4c42-b6bf-b3b3ced81dd9 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:12.559503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1230/2447] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:17.156525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6742-bd4a-4d46-a13b-4c862ea9bb0f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:17.157033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6742-bd4a-4d46-a13b-4c862ea9bb0f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:17.157132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6742-bd4a-4d46-a13b-4c862ea9bb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:17.187266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:17.207402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9d3b6742-bd4a-4d46-a13b-4c862ea9bb0f None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:17.208608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9d3b6742-bd4a-4d46-a13b-4c862ea9bb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:17.225486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1218/2448] 10.222.0.79 () {58 vars in 967 bytes} [Fri May 27 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:17.239551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90031296-299d-4c42-b6bf-b3b3ced81dd9 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:17.260988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90031296-299d-4c42-b6bf-b3b3ced81dd9 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:17.266092 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca000e-0752-42fc-abde-77f81812cd4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:17.266722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca000e-0752-42fc-abde-77f81812cd4c service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:17.267005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca000e-0752-42fc-abde-77f81812cd4c service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:17.267281 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca000e-0752-42fc-abde-77f81812cd4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:17.275250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca000e-0752-42fc-abde-77f81812cd4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:17.276820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca000e-0752-42fc-abde-77f81812cd4c service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:17.284679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1231/2449] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:39:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:39:18.679437 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fea4e-f7a8-4886-b6d2-d37d39dc483d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.679890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fea4e-f7a8-4886-b6d2-d37d39dc483d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.680127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fea4e-f7a8-4886-b6d2-d37d39dc483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.698870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f33fea4e-f7a8-4886-b6d2-d37d39dc483d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:18.700074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f33fea4e-f7a8-4886-b6d2-d37d39dc483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:18.708124 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1219/2450] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:18.759408 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca000e-0752-42fc-abde-77f81812cd4c service swift] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:18.772184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca000e-0752-42fc-abde-77f81812cd4c service swift] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:18.777878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813bc70-7f40-416f-aad5-7d1365e07810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:18.778518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813bc70-7f40-416f-aad5-7d1365e07810 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.778800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813bc70-7f40-416f-aad5-7d1365e07810 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.779084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813bc70-7f40-416f-aad5-7d1365e07810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.788137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813bc70-7f40-416f-aad5-7d1365e07810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:18.789751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813bc70-7f40-416f-aad5-7d1365e07810 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:18.799369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1232/2451] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:19.180889 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fea4e-f7a8-4886-b6d2-d37d39dc483d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.182436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f33fea4e-f7a8-4886-b6d2-d37d39dc483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.194914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fea4e-f7a8-4886-b6d2-d37d39dc483d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.199524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.200390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.200677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.200997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] PATH_INFO: `/v3/users/3ff6440aa1c54abe840dac4390335744` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.202184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff6440aa1c54abe840dac4390335744)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.204099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.256650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff6440aa1c54abe840dac4390335744'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.268420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff6440aa1c54abe840dac4390335744'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.269285 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff6440aa1c54abe840dac4390335744'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.277523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff6440aa1c54abe840dac4390335744'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.278250 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1a4c2e6b-9658-4073-a15e-003b35f53206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff6440aa1c54abe840dac4390335744'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.293745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1220/2452] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:39:19 2022] DELETE /identity/v3/users/3ff6440aa1c54abe840dac4390335744 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:19.461814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813bc70-7f40-416f-aad5-7d1365e07810 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.472774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813bc70-7f40-416f-aad5-7d1365e07810 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.500923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:19.538647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.539523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.539805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.540081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] PATH_INFO: `/v3/projects/5fe88e92cd7346e6948ff580f98ddb19` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.541321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe88e92cd7346e6948ff580f98ddb19)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.543322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.595460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe88e92cd7346e6948ff580f98ddb19', 'request_id': 'req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.601166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe88e92cd7346e6948ff580f98ddb19', 'request_id': 'req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.607694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe88e92cd7346e6948ff580f98ddb19', 'request_id': 'req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.623051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] The token cache is being invalidate because project 5fe88e92cd7346e6948ff580f98ddb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:19.623367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.623988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1595f54b-fcab-47dc-9772-c5a8f8f9dcf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.625593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1233/2453] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:39:19 2022] DELETE /identity/v3/projects/5fe88e92cd7346e6948ff580f98ddb19 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:19.631276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192bb6-0f2b-457d-a498-57ac1a2c04ae None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.631443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192bb6-0f2b-457d-a498-57ac1a2c04ae None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.631743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192bb6-0f2b-457d-a498-57ac1a2c04ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.650514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1f192bb6-0f2b-457d-a498-57ac1a2c04ae None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:19.651722 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1f192bb6-0f2b-457d-a498-57ac1a2c04ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.709501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1221/2454] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:19.717401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37951-2d87-40f2-8ea9-9a465d4daaa5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.717697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37951-2d87-40f2-8ea9-9a465d4daaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.717968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37951-2d87-40f2-8ea9-9a465d4daaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.735733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-91f37951-2d87-40f2-8ea9-9a465d4daaa5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:19.736952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-91f37951-2d87-40f2-8ea9-9a465d4daaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.744721 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1234/2455] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:19.748955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f192bb6-0f2b-457d-a498-57ac1a2c04ae None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.758916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f192bb6-0f2b-457d-a498-57ac1a2c04ae None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.763518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.764170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.764457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.764762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.765520 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:19.765833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.767471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.779390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1222/2456] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:19.783476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37951-2d87-40f2-8ea9-9a465d4daaa5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.792633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37951-2d87-40f2-8ea9-9a465d4daaa5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.797274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3e52c-ca7c-4743-b82c-0041129d73ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.797920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e52c-ca7c-4743-b82c-0041129d73ce admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.798199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e52c-ca7c-4743-b82c-0041129d73ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.798474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e52c-ca7c-4743-b82c-0041129d73ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.799192 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3e52c-ca7c-4743-b82c-0041129d73ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.801122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3e52c-ca7c-4743-b82c-0041129d73ce admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.825847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1235/2457] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:39:19 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:19.829765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.841022 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3abd29-3dd9-438c-bf98-9241356d6bb7 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.873074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:19.900551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77290eb2-cbe8-435b-ae3d-282f1fc8a7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.901252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290eb2-cbe8-435b-ae3d-282f1fc8a7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.901540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290eb2-cbe8-435b-ae3d-282f1fc8a7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.901851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290eb2-cbe8-435b-ae3d-282f1fc8a7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.902550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77290eb2-cbe8-435b-ae3d-282f1fc8a7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.904474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77290eb2-cbe8-435b-ae3d-282f1fc8a7c1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.926375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1223/2458] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:39:19 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:19.928285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3e52c-ca7c-4743-b82c-0041129d73ce admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.938459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3e52c-ca7c-4743-b82c-0041129d73ce admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.943680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197c7b-8c4e-40e5-adbd-2d7250a75d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.944333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197c7b-8c4e-40e5-adbd-2d7250a75d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.944615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197c7b-8c4e-40e5-adbd-2d7250a75d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.944927 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197c7b-8c4e-40e5-adbd-2d7250a75d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.945645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99197c7b-8c4e-40e5-adbd-2d7250a75d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.947240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99197c7b-8c4e-40e5-adbd-2d7250a75d97 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.957782 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1236/2459] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:19.961342 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77290eb2-cbe8-435b-ae3d-282f1fc8a7c1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.971193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77290eb2-cbe8-435b-ae3d-282f1fc8a7c1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.975897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a689adb-8523-4db7-b9d4-3175545304eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.976548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a689adb-8523-4db7-b9d4-3175545304eb admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.976857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a689adb-8523-4db7-b9d4-3175545304eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.977135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a689adb-8523-4db7-b9d4-3175545304eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.977856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a689adb-8523-4db7-b9d4-3175545304eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.979443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a689adb-8523-4db7-b9d4-3175545304eb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.989314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1224/2460] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:19.993831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197c7b-8c4e-40e5-adbd-2d7250a75d97 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:20.003522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197c7b-8c4e-40e5-adbd-2d7250a75d97 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:20.008763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:20.009651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.009935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.010210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] PATH_INFO: `/v3/projects/ca917611cacf43a58fc1b39d419e1600/users/e8a84d4eea5b46b4a298d28e978fef89/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.024240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca917611cacf43a58fc1b39d419e1600, user_id=e8a84d4eea5b46b4a298d28e978fef89, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:20.026921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:20.039427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1237/2461] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:39:19 2022] PUT /identity/v3/projects/ca917611cacf43a58fc1b39d419e1600/users/e8a84d4eea5b46b4a298d28e978fef89/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:20.049026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f4fd-f20b-44a4-a61d-c80c50a75c7a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.049436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f4fd-f20b-44a4-a61d-c80c50a75c7a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.049728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f4fd-f20b-44a4-a61d-c80c50a75c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.078363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b323f4fd-f20b-44a4-a61d-c80c50a75c7a None None] MFA Rules not processed for user `e8a84d4eea5b46b4a298d28e978fef89`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:20.079591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b323f4fd-f20b-44a4-a61d-c80c50a75c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:20.147276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1225/2462] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:20.158200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:20.159897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:20.222965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:20.248485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd777037-e010-4d68-89df-6ced33840780 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:20.252161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dc28e-d9bc-42b6-9274-8c7508f6adf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:20.252805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc28e-d9bc-42b6-9274-8c7508f6adf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.253118 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc28e-d9bc-42b6-9274-8c7508f6adf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.253397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc28e-d9bc-42b6-9274-8c7508f6adf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.262519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dc28e-d9bc-42b6-9274-8c7508f6adf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:20.263946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dc28e-d9bc-42b6-9274-8c7508f6adf5 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:20.272612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1238/2463] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:30.144201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:30.268685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=11 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:35.079830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b90040-bf2c-4bb0-ada2-1c0a612e812a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:35.080444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b90040-bf2c-4bb0-ada2-1c0a612e812a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:35.080553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b90040-bf2c-4bb0-ada2-1c0a612e812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:35.099012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-00b90040-bf2c-4bb0-ada2-1c0a612e812a None None] MFA Rules not processed for user `8eab82d35b6a4b02ae5fd84171edad20`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:35.100193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-00b90040-bf2c-4bb0-ada2-1c0a612e812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:35.157155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1226/2464] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:45.150233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=25 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.998588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8752a-d63b-4c97-8aa7-ada6c9d22d3f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.999178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8752a-d63b-4c97-8aa7-ada6c9d22d3f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.999178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8752a-d63b-4c97-8aa7-ada6c9d22d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.016539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c0e8752a-d63b-4c97-8aa7-ada6c9d22d3f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:49.017775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c0e8752a-d63b-4c97-8aa7-ada6c9d22d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:49.074801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1239/2465] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:49.098454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b90040-bf2c-4bb0-ada2-1c0a612e812a None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.099791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-00b90040-bf2c-4bb0-ada2-1c0a612e812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:49.175151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b90040-bf2c-4bb0-ada2-1c0a612e812a None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.180817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694f877-e320-43d5-bbe8-e546f05c1bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.181497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f877-e320-43d5-bbe8-e546f05c1bcc service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.181803 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f877-e320-43d5-bbe8-e546f05c1bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.182087 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f877-e320-43d5-bbe8-e546f05c1bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.190448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694f877-e320-43d5-bbe8-e546f05c1bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.192029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694f877-e320-43d5-bbe8-e546f05c1bcc service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.201974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1227/2466] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:51.908879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8752a-d63b-4c97-8aa7-ada6c9d22d3f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:51.918747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8752a-d63b-4c97-8aa7-ada6c9d22d3f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:51.923273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:51.924137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:51.924424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:51.924704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] PATH_INFO: `/v3/users/e8a84d4eea5b46b4a298d28e978fef89` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:51.925933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a84d4eea5b46b4a298d28e978fef89)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:51.927866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:51.975105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a84d4eea5b46b4a298d28e978fef89'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.986563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a84d4eea5b46b4a298d28e978fef89'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.994191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a84d4eea5b46b4a298d28e978fef89'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.994886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a84d4eea5b46b4a298d28e978fef89'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:51.995496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a84d4eea5b46b4a298d28e978fef89'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.008235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1240/2467] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:39:51 2022] DELETE /identity/v3/users/e8a84d4eea5b46b4a298d28e978fef89 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:52.013048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49b231-3ba8-45e8-9ff5-d5bdcb5145ce None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.013524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49b231-3ba8-45e8-9ff5-d5bdcb5145ce None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.013633 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49b231-3ba8-45e8-9ff5-d5bdcb5145ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.032220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1e49b231-3ba8-45e8-9ff5-d5bdcb5145ce None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:52.033466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1e49b231-3ba8-45e8-9ff5-d5bdcb5145ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.090379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1228/2468] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:52.100201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.101680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.157674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244bc8c-4ed5-449e-8aeb-2a0257dab1f8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.161330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1144750-16b1-4d9b-b66c-e114c8712f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.161993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144750-16b1-4d9b-b66c-e114c8712f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.162273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144750-16b1-4d9b-b66c-e114c8712f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.163066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144750-16b1-4d9b-b66c-e114c8712f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.171988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1144750-16b1-4d9b-b66c-e114c8712f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.173449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1144750-16b1-4d9b-b66c-e114c8712f96 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.183010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1241/2469] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:52.456894 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49b231-3ba8-45e8-9ff5-d5bdcb5145ce None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.458447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1e49b231-3ba8-45e8-9ff5-d5bdcb5145ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.471606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49b231-3ba8-45e8-9ff5-d5bdcb5145ce None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.476910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.477767 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.478050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.478326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] PATH_INFO: `/v3/projects/ca917611cacf43a58fc1b39d419e1600` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.479970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca917611cacf43a58fc1b39d419e1600)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.481553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.536051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca917611cacf43a58fc1b39d419e1600', 'request_id': 'req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.542648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca917611cacf43a58fc1b39d419e1600', 'request_id': 'req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.549110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca917611cacf43a58fc1b39d419e1600', 'request_id': 'req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.566989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] The token cache is being invalidate because project ca917611cacf43a58fc1b39d419e1600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:52.567594 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.568502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-94bf54f0-dc4e-4df8-a5c5-8c8e63fb311e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:52.573980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1229/2470] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:39:52 2022] DELETE /identity/v3/projects/ca917611cacf43a58fc1b39d419e1600 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:52.575665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9f63a-60db-40cb-bc9c-ef705fcbc568 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.575962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9f63a-60db-40cb-bc9c-ef705fcbc568 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.576247 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9f63a-60db-40cb-bc9c-ef705fcbc568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.596346 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ffa9f63a-60db-40cb-bc9c-ef705fcbc568 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:52.597602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ffa9f63a-60db-40cb-bc9c-ef705fcbc568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.607137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:52.659057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1242/2471] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:52.667346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee230de-4919-4c3f-ba1c-413b9b71eb9f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.667637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee230de-4919-4c3f-ba1c-413b9b71eb9f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.667918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee230de-4919-4c3f-ba1c-413b9b71eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.686413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-0ee230de-4919-4c3f-ba1c-413b9b71eb9f None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:52.687645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0ee230de-4919-4c3f-ba1c-413b9b71eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:52.696084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1230/2472] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:52.700123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9f63a-60db-40cb-bc9c-ef705fcbc568 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.709965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9f63a-60db-40cb-bc9c-ef705fcbc568 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.714593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.715259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.715543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.715820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.716597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:52.716950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.718829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.733717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1243/2473] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:52.734962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee230de-4919-4c3f-ba1c-413b9b71eb9f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.739382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:52.746282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee230de-4919-4c3f-ba1c-413b9b71eb9f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.752053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa14684-c8dc-4a12-9e87-6c0be8dcb877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.752716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa14684-c8dc-4a12-9e87-6c0be8dcb877 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.753040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa14684-c8dc-4a12-9e87-6c0be8dcb877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.753323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa14684-c8dc-4a12-9e87-6c0be8dcb877 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.754015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa14684-c8dc-4a12-9e87-6c0be8dcb877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.755963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa14684-c8dc-4a12-9e87-6c0be8dcb877 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.783671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1231/2474] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:52.787769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.798736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef36f-c592-49ed-93d5-6b61b05e77d5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.859011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fb99-1d74-41e0-9393-e11c0f68bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.859695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fb99-1d74-41e0-9393-e11c0f68bb14 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.859987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fb99-1d74-41e0-9393-e11c0f68bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.860268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fb99-1d74-41e0-9393-e11c0f68bb14 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.861185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013fb99-1d74-41e0-9393-e11c0f68bb14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.863132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013fb99-1d74-41e0-9393-e11c0f68bb14 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.886391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1244/2475] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:39:52 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:52.890140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa14684-c8dc-4a12-9e87-6c0be8dcb877 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.901494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa14684-c8dc-4a12-9e87-6c0be8dcb877 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.906361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bedf84-ec10-4536-98b2-da97a0c0ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.907030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bedf84-ec10-4536-98b2-da97a0c0ee18 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.907313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bedf84-ec10-4536-98b2-da97a0c0ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.907593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bedf84-ec10-4536-98b2-da97a0c0ee18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.908324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bedf84-ec10-4536-98b2-da97a0c0ee18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.910017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bedf84-ec10-4536-98b2-da97a0c0ee18 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.920546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1232/2476] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:52.924403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fb99-1d74-41e0-9393-e11c0f68bb14 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.934372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fb99-1d74-41e0-9393-e11c0f68bb14 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.939014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbb4a7-2c77-4be3-94be-8f39fbdf9720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.939738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb4a7-2c77-4be3-94be-8f39fbdf9720 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.939988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb4a7-2c77-4be3-94be-8f39fbdf9720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.940259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb4a7-2c77-4be3-94be-8f39fbdf9720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.941016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbb4a7-2c77-4be3-94be-8f39fbdf9720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.942615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbb4a7-2c77-4be3-94be-8f39fbdf9720 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:52.953304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1245/2477] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:52.957522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bedf84-ec10-4536-98b2-da97a0c0ee18 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:52.969166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bedf84-ec10-4536-98b2-da97a0c0ee18 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:52.973890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:52.975009 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:52.975354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:52.975696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] PATH_INFO: `/v3/projects/bc7dcc6276864bcd9998c09b4b29d918/users/5ec22f6570e3463ba2ab19ded2512699/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:52.990885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7dcc6276864bcd9998c09b4b29d918, user_id=5ec22f6570e3463ba2ab19ded2512699, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:52.993578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.008142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1233/2478] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:39:52 2022] PUT /identity/v3/projects/bc7dcc6276864bcd9998c09b4b29d918/users/5ec22f6570e3463ba2ab19ded2512699/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:53.017778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445f22-3a7b-4ca7-b8e8-03ae975fde70 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.018071 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445f22-3a7b-4ca7-b8e8-03ae975fde70 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.018360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445f22-3a7b-4ca7-b8e8-03ae975fde70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.044980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a9445f22-3a7b-4ca7-b8e8-03ae975fde70 None None] MFA Rules not processed for user `5ec22f6570e3463ba2ab19ded2512699`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:53.046208 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a9445f22-3a7b-4ca7-b8e8-03ae975fde70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:53.110351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1246/2479] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:53.121592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:53.123688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:53.189308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fdd42-e663-4729-8c53-d7724758ee57 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:53.192841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17d583-170e-43dd-b5ac-fd60e296a977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:53.193494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d583-170e-43dd-b5ac-fd60e296a977 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.194334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d583-170e-43dd-b5ac-fd60e296a977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.194607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17d583-170e-43dd-b5ac-fd60e296a977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.202988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17d583-170e-43dd-b5ac-fd60e296a977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:53.204413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17d583-170e-43dd-b5ac-fd60e296a977 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.213719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1234/2480] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:53.240331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9445f22-3a7b-4ca7-b8e8-03ae975fde70 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:53.252576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:53.321278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9445f22-3a7b-4ca7-b8e8-03ae975fde70 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:53.326129 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:53.327014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.327299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.327577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] PATH_INFO: `/v3/users/5ec22f6570e3463ba2ab19ded2512699` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.328810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec22f6570e3463ba2ab19ded2512699)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:53.330828 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.385161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec22f6570e3463ba2ab19ded2512699'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:53.399785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec22f6570e3463ba2ab19ded2512699'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:53.407394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec22f6570e3463ba2ab19ded2512699'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:53.408724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec22f6570e3463ba2ab19ded2512699'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:53.408968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec22f6570e3463ba2ab19ded2512699'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:53.424337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1247/2481] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:39:53 2022] DELETE /identity/v3/users/5ec22f6570e3463ba2ab19ded2512699 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:53.430054 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9645f-7562-47e1-95e9-d6acd31d4abe None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.430350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9645f-7562-47e1-95e9-d6acd31d4abe None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.430644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9645f-7562-47e1-95e9-d6acd31d4abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.449644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f1b9645f-7562-47e1-95e9-d6acd31d4abe None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:53.451004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f1b9645f-7562-47e1-95e9-d6acd31d4abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:53.526591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1235/2482] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:53.538326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:53.539778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:53.622936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee1693-de69-4a3c-89ad-f3fdb28eb1c0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:53.627055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:53.641462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.641641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.641948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.657361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:53.658883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.671939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1248/2483] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:53.830197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9645f-7562-47e1-95e9-d6acd31d4abe None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:53.831686 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f1b9645f-7562-47e1-95e9-d6acd31d4abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:53.897787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:53.947398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9645f-7562-47e1-95e9-d6acd31d4abe None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:53.954597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df004935-589b-4234-9acb-27c0f4e5cd61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:53.955261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df004935-589b-4234-9acb-27c0f4e5cd61 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:53.955632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df004935-589b-4234-9acb-27c0f4e5cd61 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:53.955825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df004935-589b-4234-9acb-27c0f4e5cd61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:53.957647 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-df004935-589b-4234-9acb-27c0f4e5cd61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:53.970972 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df004935-589b-4234-9acb-27c0f4e5cd61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:53.972582 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df004935-589b-4234-9acb-27c0f4e5cd61 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:53.985626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1236/2484] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:54.033743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.035219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:54.069033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14a59-2d6a-420b-a448-f1b082a9196b service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.086761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.088350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.088760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.089080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] PATH_INFO: `/v3/projects/bc7dcc6276864bcd9998c09b4b29d918` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.091137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7dcc6276864bcd9998c09b4b29d918)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.093357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.180402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:54.205169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7dcc6276864bcd9998c09b4b29d918', 'request_id': 'req-0df39e61-4f74-40f2-9260-65664939ce3e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.214829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7dcc6276864bcd9998c09b4b29d918', 'request_id': 'req-0df39e61-4f74-40f2-9260-65664939ce3e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.222516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7dcc6276864bcd9998c09b4b29d918', 'request_id': 'req-0df39e61-4f74-40f2-9260-65664939ce3e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.244625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] The token cache is being invalidate because project bc7dcc6276864bcd9998c09b4b29d918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:54.245177 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.246048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0df39e61-4f74-40f2-9260-65664939ce3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.248058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1249/2485] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:39:54 2022] DELETE /identity/v3/projects/bc7dcc6276864bcd9998c09b4b29d918 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:54.255642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd88eb3-ae4c-4ecb-9014-44645e7ad06b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.255642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd88eb3-ae4c-4ecb-9014-44645e7ad06b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.255642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd88eb3-ae4c-4ecb-9014-44645e7ad06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.282225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5bd88eb3-ae4c-4ecb-9014-44645e7ad06b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:54.283402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5bd88eb3-ae4c-4ecb-9014-44645e7ad06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:54.363488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1237/2486] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:54.371467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f006b-db1e-4958-9c45-10237b6ea9af None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.371756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f006b-db1e-4958-9c45-10237b6ea9af None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.372034 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f006b-db1e-4958-9c45-10237b6ea9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.403012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c57f006b-db1e-4958-9c45-10237b6ea9af None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:54.404708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c57f006b-db1e-4958-9c45-10237b6ea9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:54.412187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3e12-047c-46c1-83e2-a8a4e755eaa7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.412955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3e12-047c-46c1-83e2-a8a4e755eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.413598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3e12-047c-46c1-83e2-a8a4e755eaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.414867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1250/2487] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:54.418875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f006b-db1e-4958-9c45-10237b6ea9af None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.431193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f006b-db1e-4958-9c45-10237b6ea9af None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.436210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.437429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.437429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.437649 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.438279 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:54.438587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.440330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.446787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ebbc3e12-047c-46c1-83e2-a8a4e755eaa7 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:54.448029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ebbc3e12-047c-46c1-83e2-a8a4e755eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:54.457951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1251/2488] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:54.461244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.472740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f1f61-c2c8-4384-ad57-ab44638a7790 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.477157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1238/2489] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:54.478584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8fb0f-e217-4861-8bad-7c97288e5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.479668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8fb0f-e217-4861-8bad-7c97288e5013 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.480148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8fb0f-e217-4861-8bad-7c97288e5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.480681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8fb0f-e217-4861-8bad-7c97288e5013 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.481624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8fb0f-e217-4861-8bad-7c97288e5013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.483781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8fb0f-e217-4861-8bad-7c97288e5013 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.500073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3e12-047c-46c1-83e2-a8a4e755eaa7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.501499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ebbc3e12-047c-46c1-83e2-a8a4e755eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:54.542902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1252/2490] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:39:54 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:54.545209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8fb0f-e217-4861-8bad-7c97288e5013 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.644778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3e12-047c-46c1-83e2-a8a4e755eaa7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.645574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8fb0f-e217-4861-8bad-7c97288e5013 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.652669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e665c-9e84-420b-b69c-7e9ea22efa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.654440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e665c-9e84-420b-b69c-7e9ea22efa8d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.654952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e665c-9e84-420b-b69c-7e9ea22efa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.656463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e665c-9e84-420b-b69c-7e9ea22efa8d admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.657495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e665c-9e84-420b-b69c-7e9ea22efa8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.661200 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e665c-9e84-420b-b69c-7e9ea22efa8d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.697220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1253/2491] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:39:54 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:54.700025 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e665c-9e84-420b-b69c-7e9ea22efa8d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.715014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e665c-9e84-420b-b69c-7e9ea22efa8d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.718043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:54.723756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85ffd9-ae36-442c-8c15-bad5c1e5546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.730334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ffd9-ae36-442c-8c15-bad5c1e5546a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.730760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ffd9-ae36-442c-8c15-bad5c1e5546a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.731117 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ffd9-ae36-442c-8c15-bad5c1e5546a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.732082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85ffd9-ae36-442c-8c15-bad5c1e5546a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.734018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85ffd9-ae36-442c-8c15-bad5c1e5546a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.739918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed0018-18bd-4d1f-aeaa-c66aeec9d492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.741282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0018-18bd-4d1f-aeaa-c66aeec9d492 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.741282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0018-18bd-4d1f-aeaa-c66aeec9d492 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.741742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0018-18bd-4d1f-aeaa-c66aeec9d492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.748508 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1254/2492] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:54.753836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85ffd9-ae36-442c-8c15-bad5c1e5546a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.757604 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed0018-18bd-4d1f-aeaa-c66aeec9d492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.759375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed0018-18bd-4d1f-aeaa-c66aeec9d492 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.765992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85ffd9-ae36-442c-8c15-bad5c1e5546a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.775458 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398bc0d-1006-4ce7-af08-644adaeb155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.776270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398bc0d-1006-4ce7-af08-644adaeb155c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.776657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398bc0d-1006-4ce7-af08-644adaeb155c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.777169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398bc0d-1006-4ce7-af08-644adaeb155c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.777889 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398bc0d-1006-4ce7-af08-644adaeb155c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.781749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398bc0d-1006-4ce7-af08-644adaeb155c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.786764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1239/2493] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:54.804068 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1255/2494] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:54.808506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed0018-18bd-4d1f-aeaa-c66aeec9d492 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.825564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed0018-18bd-4d1f-aeaa-c66aeec9d492 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.843092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.843990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.844278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.844557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] PATH_INFO: `/v3/projects/da4b0c2f57db4ca79e551f75ceea988b/users/f0e370c9bd904c7594d86eab2a8b1a97/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.868286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4b0c2f57db4ca79e551f75ceea988b, user_id=f0e370c9bd904c7594d86eab2a8b1a97, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.871781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.892030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1240/2495] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:39:54 2022] PUT /identity/v3/projects/da4b0c2f57db4ca79e551f75ceea988b/users/f0e370c9bd904c7594d86eab2a8b1a97/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:54.905097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82519-b02b-4e2c-87fb-e0d133b61ea8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.905493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82519-b02b-4e2c-87fb-e0d133b61ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.905852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82519-b02b-4e2c-87fb-e0d133b61ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.941330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0ce82519-b02b-4e2c-87fb-e0d133b61ea8 None None] MFA Rules not processed for user `f0e370c9bd904c7594d86eab2a8b1a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:54.942834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0ce82519-b02b-4e2c-87fb-e0d133b61ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:54.986628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:55.036988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1256/2496] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:55.049241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:55.051068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:55.153138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc59c3-f6d3-42e4-9caa-7df36491b6e2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:55.156960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:55.157715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.158104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.158485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.167419 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:55.169388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:55.181412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1241/2497] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:57.492943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82930db-7edf-4ded-b497-03d811be8d4b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:57.493437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82930db-7edf-4ded-b497-03d811be8d4b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:57.493558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82930db-7edf-4ded-b497-03d811be8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:57.511483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d82930db-7edf-4ded-b497-03d811be8d4b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:57.512682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d82930db-7edf-4ded-b497-03d811be8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:57.569519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1257/2498] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:57.593068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:57.594536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:57.666664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db39a2-f57e-45f8-8edd-e914ea8a7a39 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:57.672158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5541aa-95b2-46af-8006-fb5eba4f68d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:57.672801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5541aa-95b2-46af-8006-fb5eba4f68d4 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:57.673123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5541aa-95b2-46af-8006-fb5eba4f68d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:57.673405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5541aa-95b2-46af-8006-fb5eba4f68d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:57.682181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5541aa-95b2-46af-8006-fb5eba4f68d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:57.683774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5541aa-95b2-46af-8006-fb5eba4f68d4 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:57.693121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1242/2499] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:02.686638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4625-2852-4d3c-bc26-d67d63878c32 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.687106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4625-2852-4d3c-bc26-d67d63878c32 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.687257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4625-2852-4d3c-bc26-d67d63878c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.721972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ae1f4625-2852-4d3c-bc26-d67d63878c32 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:02.723233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ae1f4625-2852-4d3c-bc26-d67d63878c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:02.732633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1258/2500] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:02.754008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5541aa-95b2-46af-8006-fb5eba4f68d4 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:02.767515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5541aa-95b2-46af-8006-fb5eba4f68d4 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:02.775198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be34255-bbf3-4f30-be8d-b4388ee7cc6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:02.775858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34255-bbf3-4f30-be8d-b4388ee7cc6e service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.776126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34255-bbf3-4f30-be8d-b4388ee7cc6e service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.776403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34255-bbf3-4f30-be8d-b4388ee7cc6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.785470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be34255-bbf3-4f30-be8d-b4388ee7cc6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:02.787135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be34255-bbf3-4f30-be8d-b4388ee7cc6e service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:02.798158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1243/2501] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:05.109603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8096c-6c03-4e58-915e-4f8cb766808d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.110132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8096c-6c03-4e58-915e-4f8cb766808d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.110132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8096c-6c03-4e58-915e-4f8cb766808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.128119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eff8096c-6c03-4e58-915e-4f8cb766808d None None] MFA Rules not processed for user `1a3ca370feb4457dbadc476e348ac9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:05.129357 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eff8096c-6c03-4e58-915e-4f8cb766808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:05.186590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1259/2502] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:40:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:05.341159 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be34255-bbf3-4f30-be8d-b4388ee7cc6e service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.351517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be34255-bbf3-4f30-be8d-b4388ee7cc6e service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.356035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.356955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.357235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.357520 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] PATH_INFO: `/v3/users/f0e370c9bd904c7594d86eab2a8b1a97` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.358843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e370c9bd904c7594d86eab2a8b1a97)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.360775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.385974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:05.415178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e370c9bd904c7594d86eab2a8b1a97'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:05.427540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e370c9bd904c7594d86eab2a8b1a97'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:05.428301 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e370c9bd904c7594d86eab2a8b1a97'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:05.436284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e370c9bd904c7594d86eab2a8b1a97'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:05.436999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e370c9bd904c7594d86eab2a8b1a97'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:05.449658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1244/2503] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:40:05 2022] DELETE /identity/v3/users/f0e370c9bd904c7594d86eab2a8b1a97 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:05.454190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2659fc-40ad-4be9-99c7-fb275fab6b26 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.454480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2659fc-40ad-4be9-99c7-fb275fab6b26 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.454755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2659fc-40ad-4be9-99c7-fb275fab6b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.472700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bc2659fc-40ad-4be9-99c7-fb275fab6b26 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:05.473955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bc2659fc-40ad-4be9-99c7-fb275fab6b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:05.533578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1260/2504] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:05.543761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.545896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:05.606966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde3409-ce18-43ef-bcc4-3914e8bbc10b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.610558 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e466f5-791c-4034-aa40-69dbe3923a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.611212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e466f5-791c-4034-aa40-69dbe3923a77 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.611495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e466f5-791c-4034-aa40-69dbe3923a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.611775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e466f5-791c-4034-aa40-69dbe3923a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.620933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e466f5-791c-4034-aa40-69dbe3923a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.622779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e466f5-791c-4034-aa40-69dbe3923a77 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.632730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1245/2505] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:05.956301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2659fc-40ad-4be9-99c7-fb275fab6b26 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.961768 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bc2659fc-40ad-4be9-99c7-fb275fab6b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:05.974796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2659fc-40ad-4be9-99c7-fb275fab6b26 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.980032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.981080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.981359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.981628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] PATH_INFO: `/v3/projects/da4b0c2f57db4ca79e551f75ceea988b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.982846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4b0c2f57db4ca79e551f75ceea988b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.984778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.992242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:06.038563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4b0c2f57db4ca79e551f75ceea988b', 'request_id': 'req-240870d1-335f-43e1-b7a3-99e20c778a45'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:06.044305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4b0c2f57db4ca79e551f75ceea988b', 'request_id': 'req-240870d1-335f-43e1-b7a3-99e20c778a45'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:06.050536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4b0c2f57db4ca79e551f75ceea988b', 'request_id': 'req-240870d1-335f-43e1-b7a3-99e20c778a45'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:06.064207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] The token cache is being invalidate because project da4b0c2f57db4ca79e551f75ceea988b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:06.064572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:06.065379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-240870d1-335f-43e1-b7a3-99e20c778a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:06.067108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1261/2506] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:40:05 2022] DELETE /identity/v3/projects/da4b0c2f57db4ca79e551f75ceea988b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:06.072491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d161-e6ca-4ea4-858c-14fc905cc4a3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.072788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d161-e6ca-4ea4-858c-14fc905cc4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.073119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d161-e6ca-4ea4-858c-14fc905cc4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.091336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b852d161-e6ca-4ea4-858c-14fc905cc4a3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:06.092846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b852d161-e6ca-4ea4-858c-14fc905cc4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:06.156651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1246/2507] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:06.164348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb1fa-7065-4448-a825-8c79ff1fba08 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.164888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb1fa-7065-4448-a825-8c79ff1fba08 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.165001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb1fa-7065-4448-a825-8c79ff1fba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.187735 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9ebdb1fa-7065-4448-a825-8c79ff1fba08 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:06.189453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9ebdb1fa-7065-4448-a825-8c79ff1fba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:06.199640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1262/2508] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:06.204143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852d161-e6ca-4ea4-858c-14fc905cc4a3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:06.215424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852d161-e6ca-4ea4-858c-14fc905cc4a3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:06.220281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:06.220973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.221261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.221544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.222267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:06.222575 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:06.224181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:06.235756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1247/2509] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:06.239740 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdb1fa-7065-4448-a825-8c79ff1fba08 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:06.249283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdb1fa-7065-4448-a825-8c79ff1fba08 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:06.253891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48dadf-72c7-41d6-a55e-dcf826bd0552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:06.254526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48dadf-72c7-41d6-a55e-dcf826bd0552 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.254804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48dadf-72c7-41d6-a55e-dcf826bd0552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.255077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48dadf-72c7-41d6-a55e-dcf826bd0552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.256420 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48dadf-72c7-41d6-a55e-dcf826bd0552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:06.258345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48dadf-72c7-41d6-a55e-dcf826bd0552 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:06.283440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1263/2510] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:40:06 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:06.287497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:06.301896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3296f-6bb0-4dba-bd73-78cb6bed0b2d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:06.324904 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:06.356050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366f56b-6546-4b1a-9371-138485355e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:06.356784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f56b-6546-4b1a-9371-138485355e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.357109 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f56b-6546-4b1a-9371-138485355e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.357391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f56b-6546-4b1a-9371-138485355e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.358120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366f56b-6546-4b1a-9371-138485355e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:06.360037 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366f56b-6546-4b1a-9371-138485355e1c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:06.379807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1248/2511] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:40:06 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:06.384401 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48dadf-72c7-41d6-a55e-dcf826bd0552 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:06.394574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48dadf-72c7-41d6-a55e-dcf826bd0552 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:06.399233 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21688514-78e5-41db-a191-71a05a9f87d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:06.399887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21688514-78e5-41db-a191-71a05a9f87d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.400170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21688514-78e5-41db-a191-71a05a9f87d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.400450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21688514-78e5-41db-a191-71a05a9f87d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.401202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21688514-78e5-41db-a191-71a05a9f87d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:06.402808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21688514-78e5-41db-a191-71a05a9f87d2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:06.413715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1264/2512] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:06.417718 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366f56b-6546-4b1a-9371-138485355e1c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:06.428895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366f56b-6546-4b1a-9371-138485355e1c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:06.434617 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bad0e-480f-4770-a03c-269a933ff004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:06.436351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bad0e-480f-4770-a03c-269a933ff004 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.436684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bad0e-480f-4770-a03c-269a933ff004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.441013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bad0e-480f-4770-a03c-269a933ff004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.442859 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bad0e-480f-4770-a03c-269a933ff004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:06.445585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bad0e-480f-4770-a03c-269a933ff004 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:06.463491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1249/2513] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:06.465536 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21688514-78e5-41db-a191-71a05a9f87d2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:06.478647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21688514-78e5-41db-a191-71a05a9f87d2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:06.484924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:06.485837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.486174 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.486517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] PATH_INFO: `/v3/projects/9a2fa50a3ef14060b705a3e8e0bd89b9/users/25986ce7cb5245029f1f740562835784/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.502583 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2fa50a3ef14060b705a3e8e0bd89b9, user_id=25986ce7cb5245029f1f740562835784, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:06.505321 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:06.519550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1265/2514] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:40:06 2022] PUT /identity/v3/projects/9a2fa50a3ef14060b705a3e8e0bd89b9/users/25986ce7cb5245029f1f740562835784/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:06.530707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa738f-fef6-4fbc-825a-7da644bf603d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.531023 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa738f-fef6-4fbc-825a-7da644bf603d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.531297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa738f-fef6-4fbc-825a-7da644bf603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.564684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-21fa738f-fef6-4fbc-825a-7da644bf603d None None] MFA Rules not processed for user `25986ce7cb5245029f1f740562835784`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:06.565930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-21fa738f-fef6-4fbc-825a-7da644bf603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:06.633541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1250/2515] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:40:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:06.645045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:06.646803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:06.718860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a572e8-51c2-4130-bb5f-13d4a5633709 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:06.723473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:06.724115 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.724984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.725267 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.734540 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:06.736237 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:06.746110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1266/2516] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:40:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:07.907291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235453-c6ca-46c8-af77-c738cbb670e2 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:07.907752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235453-c6ca-46c8-af77-c738cbb670e2 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:07.907941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235453-c6ca-46c8-af77-c738cbb670e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:07.937782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-69235453-c6ca-46c8-af77-c738cbb670e2 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:07.939027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-69235453-c6ca-46c8-af77-c738cbb670e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:08.023543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1251/2517] 10.222.0.76 () {58 vars in 1016 bytes} [Fri May 27 09:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:08.045265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:08.046796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:08.111978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:08.147490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbffcba-5a65-4a42-be03-8774768b734a service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:08.152993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c04a7e-77f2-45b5-8af3-d2f0ff348998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:08.154220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c04a7e-77f2-45b5-8af3-d2f0ff348998 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.154509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c04a7e-77f2-45b5-8af3-d2f0ff348998 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.154791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c04a7e-77f2-45b5-8af3-d2f0ff348998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.162853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c04a7e-77f2-45b5-8af3-d2f0ff348998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:08.164489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c04a7e-77f2-45b5-8af3-d2f0ff348998 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:08.176197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1267/2518] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:11.800394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235453-c6ca-46c8-af77-c738cbb670e2 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.810397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235453-c6ca-46c8-af77-c738cbb670e2 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.815367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.816235 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.816520 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.816797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] PATH_INFO: `/v3/users/25986ce7cb5245029f1f740562835784` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.818029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25986ce7cb5245029f1f740562835784)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.820016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.858557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:11.873122 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25986ce7cb5245029f1f740562835784'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.886155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25986ce7cb5245029f1f740562835784'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.886879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25986ce7cb5245029f1f740562835784'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.893850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25986ce7cb5245029f1f740562835784'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.895463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25986ce7cb5245029f1f740562835784'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.907517 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1252/2519] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:40:11 2022] DELETE /identity/v3/users/25986ce7cb5245029f1f740562835784 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:11.912055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aaad9-65c8-48ae-8276-f6489003db9e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.912534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aaad9-65c8-48ae-8276-f6489003db9e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.913257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aaad9-65c8-48ae-8276-f6489003db9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.930328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f51aaad9-65c8-48ae-8276-f6489003db9e None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:11.931495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f51aaad9-65c8-48ae-8276-f6489003db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:11.989601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1268/2520] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:11.999265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:12.000690 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:12.059178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47069-7961-4aef-96ce-9ddb896cb583 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:12.062882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34e48-fa90-48ed-9cec-7dffe57d697b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:12.063529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34e48-fa90-48ed-9cec-7dffe57d697b service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:12.063816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34e48-fa90-48ed-9cec-7dffe57d697b service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:12.064099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34e48-fa90-48ed-9cec-7dffe57d697b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:12.073587 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34e48-fa90-48ed-9cec-7dffe57d697b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:12.075063 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34e48-fa90-48ed-9cec-7dffe57d697b service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:12.085509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1253/2521] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:12.368989 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aaad9-65c8-48ae-8276-f6489003db9e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:12.370772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f51aaad9-65c8-48ae-8276-f6489003db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:12.384355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aaad9-65c8-48ae-8276-f6489003db9e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:12.389775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:12.390654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:12.390933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:12.391207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] PATH_INFO: `/v3/projects/9a2fa50a3ef14060b705a3e8e0bd89b9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:12.392433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2fa50a3ef14060b705a3e8e0bd89b9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:12.394429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:12.461016 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2fa50a3ef14060b705a3e8e0bd89b9', 'request_id': 'req-e7e6a177-cd3c-43e7-a56b-d7befbb53625'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.468767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2fa50a3ef14060b705a3e8e0bd89b9', 'request_id': 'req-e7e6a177-cd3c-43e7-a56b-d7befbb53625'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.476719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2fa50a3ef14060b705a3e8e0bd89b9', 'request_id': 'req-e7e6a177-cd3c-43e7-a56b-d7befbb53625'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.504335 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] The token cache is being invalidate because project 9a2fa50a3ef14060b705a3e8e0bd89b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:12.504658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.505476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.508893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1269/2522] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:40:12 2022] DELETE /identity/v3/projects/9a2fa50a3ef14060b705a3e8e0bd89b9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:22.080376 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=43,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:22.498794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:34.198306 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fd2a9-ea7d-427c-a453-ad4c3bbea033 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.198774 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fd2a9-ea7d-427c-a453-ad4c3bbea033 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.198874 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fd2a9-ea7d-427c-a453-ad4c3bbea033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.216854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-622fd2a9-ea7d-427c-a453-ad4c3bbea033 None None] MFA Rules not processed for user `43d9ae4fd922444e9f70fe79d4cacb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:34.218555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-622fd2a9-ea7d-427c-a453-ad4c3bbea033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:34.277308 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1254/2523] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:40:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:37.032380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:37.034002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:37.107290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a177-cd3c-43e7-a56b-d7befbb53625 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:37.111894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:37.112765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:37.113080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:37.113354 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] PATH_INFO: `/v3/users/8eab82d35b6a4b02ae5fd84171edad20` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:37.114565 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eab82d35b6a4b02ae5fd84171edad20)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:37.117122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:37.160629 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eab82d35b6a4b02ae5fd84171edad20'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.173149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eab82d35b6a4b02ae5fd84171edad20'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.180232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eab82d35b6a4b02ae5fd84171edad20'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.180857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eab82d35b6a4b02ae5fd84171edad20'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.181467 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f87cda6f-b68b-451a-b38c-344480870892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eab82d35b6a4b02ae5fd84171edad20'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.193494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1270/2524] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:40:37 2022] DELETE /identity/v3/users/8eab82d35b6a4b02ae5fd84171edad20 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:37.376641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fd2a9-ea7d-427c-a453-ad4c3bbea033 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:37.390361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fd2a9-ea7d-427c-a453-ad4c3bbea033 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:37.447408 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:37.448191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:37.448472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:37.448743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] PATH_INFO: `/v3/projects/3f0a9656f1984462a3a10b5d4b74dd04` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:37.449938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0a9656f1984462a3a10b5d4b74dd04)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:37.451838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:37.496094 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0a9656f1984462a3a10b5d4b74dd04', 'request_id': 'req-061c5c09-3708-4e2b-9092-909c6dba583e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.502060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0a9656f1984462a3a10b5d4b74dd04', 'request_id': 'req-061c5c09-3708-4e2b-9092-909c6dba583e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.508221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0a9656f1984462a3a10b5d4b74dd04', 'request_id': 'req-061c5c09-3708-4e2b-9092-909c6dba583e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.520013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] The token cache is being invalidate because project 3f0a9656f1984462a3a10b5d4b74dd04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:37.520305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.520954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-061c5c09-3708-4e2b-9092-909c6dba583e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.522507 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1255/2525] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:40:37 2022] DELETE /identity/v3/projects/3f0a9656f1984462a3a10b5d4b74dd04 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:47.190006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:47.517076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:07.784921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3be6c-5ceb-42e0-9cef-b255de2a7f76 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:07.785500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3be6c-5ceb-42e0-9cef-b255de2a7f76 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:07.785500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3be6c-5ceb-42e0-9cef-b255de2a7f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:07.802988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-86f3be6c-5ceb-42e0-9cef-b255de2a7f76 None None] MFA Rules not processed for user `1a3ca370feb4457dbadc476e348ac9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:07.804178 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-86f3be6c-5ceb-42e0-9cef-b255de2a7f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:07.857249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1271/2526] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:41:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:17.860266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=25 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:27.627549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fbbf1-6ebf-4455-af37-cbd2c8cbf123 None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:27.628555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fbbf1-6ebf-4455-af37-cbd2c8cbf123 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:27.628864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fbbf1-6ebf-4455-af37-cbd2c8cbf123 None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:27.630252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1256/2527] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:41:27.639140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf370-1a42-4bf4-aeef-288fc2742ac2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:27.639651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf370-1a42-4bf4-aeef-288fc2742ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:27.639749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf370-1a42-4bf4-aeef-288fc2742ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:27.658555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f7daf370-1a42-4bf4-aeef-288fc2742ac2 None None] MFA Rules not processed for user `ebee38389afb4270b18c6a14c7a4e302`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:27.659753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f7daf370-1a42-4bf4-aeef-288fc2742ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:27.716778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1272/2528] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:41:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:27.728754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fbbf1-6ebf-4455-af37-cbd2c8cbf123 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:27.730648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-971fbbf1-6ebf-4455-af37-cbd2c8cbf123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:27.750048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fbbf1-6ebf-4455-af37-cbd2c8cbf123 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:27.753993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665c937-1aec-4c14-8ead-d8373dc878db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:27.754715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665c937-1aec-4c14-8ead-d8373dc878db service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:27.755273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665c937-1aec-4c14-8ead-d8373dc878db service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:27.755626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665c937-1aec-4c14-8ead-d8373dc878db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:27.764474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665c937-1aec-4c14-8ead-d8373dc878db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:27.765948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665c937-1aec-4c14-8ead-d8373dc878db service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:27.774513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1257/2529] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:41:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:27.858141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990160dc-21c6-4b8f-84b4-d0be5dbe85b7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:27.858574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990160dc-21c6-4b8f-84b4-d0be5dbe85b7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:27.859017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990160dc-21c6-4b8f-84b4-d0be5dbe85b7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:27.860668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1273/2530] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:41:27.867499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fd6d-341e-48f9-b869-58f7ca14af3f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:27.868043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fd6d-341e-48f9-b869-58f7ca14af3f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:27.868346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fd6d-341e-48f9-b869-58f7ca14af3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:27.906714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7fa7fd6d-341e-48f9-b869-58f7ca14af3f None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:27.907932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7fa7fd6d-341e-48f9-b869-58f7ca14af3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:27.976143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1258/2531] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:41:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:27.986626 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990160dc-21c6-4b8f-84b4-d0be5dbe85b7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:27.988307 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-990160dc-21c6-4b8f-84b4-d0be5dbe85b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:28.001588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990160dc-21c6-4b8f-84b4-d0be5dbe85b7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:28.005141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c4262-b223-4816-84e4-1bb34ff948dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:28.005773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c4262-b223-4816-84e4-1bb34ff948dd service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:28.006569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c4262-b223-4816-84e4-1bb34ff948dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:28.006847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c4262-b223-4816-84e4-1bb34ff948dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:28.016798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c4262-b223-4816-84e4-1bb34ff948dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:28.018259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c4262-b223-4816-84e4-1bb34ff948dd service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:28.029541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1274/2532] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:41:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:36.806215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7fd6d-341e-48f9-b869-58f7ca14af3f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:36.807801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7fa7fd6d-341e-48f9-b869-58f7ca14af3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:36.879389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7fd6d-341e-48f9-b869-58f7ca14af3f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:36.884516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:36.885483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:36.885757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:36.886058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] PATH_INFO: `/v3/users/43d9ae4fd922444e9f70fe79d4cacb5d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:36.887311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d9ae4fd922444e9f70fe79d4cacb5d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:36.889305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:36.937374 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d9ae4fd922444e9f70fe79d4cacb5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:36.949651 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d9ae4fd922444e9f70fe79d4cacb5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:36.950361 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d9ae4fd922444e9f70fe79d4cacb5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:36.952878 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:36.962879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d9ae4fd922444e9f70fe79d4cacb5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:36.963502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2dfd1369-b6dc-46ad-8a52-ed1933172299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d9ae4fd922444e9f70fe79d4cacb5d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:36.984233 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1259/2533] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:41:36 2022] DELETE /identity/v3/users/43d9ae4fd922444e9f70fe79d4cacb5d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:41:37.174390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c4262-b223-4816-84e4-1bb34ff948dd service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:37.191943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c4262-b223-4816-84e4-1bb34ff948dd service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:37.255515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:37.256504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.257323 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.257602 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] PATH_INFO: `/v3/projects/a6cdccefdca74ab7b7e587e209e58ffb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.258779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6cdccefdca74ab7b7e587e209e58ffb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:37.260696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:37.310906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cdccefdca74ab7b7e587e209e58ffb', 'request_id': 'req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:37.316293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cdccefdca74ab7b7e587e209e58ffb', 'request_id': 'req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:37.322986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cdccefdca74ab7b7e587e209e58ffb', 'request_id': 'req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:37.335535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] The token cache is being invalidate because project a6cdccefdca74ab7b7e587e209e58ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:41:37.335824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:37.336451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e49cc7c4-49d5-4a5d-be97-6e333cd812a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:41:37.338049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1275/2534] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:41:37 2022] DELETE /identity/v3/projects/a6cdccefdca74ab7b7e587e209e58ffb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:41:37.343420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea09d1-2209-4317-91f2-aa5844a14dfa None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.343713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea09d1-2209-4317-91f2-aa5844a14dfa None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.344004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea09d1-2209-4317-91f2-aa5844a14dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.362215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1bea09d1-2209-4317-91f2-aa5844a14dfa None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:37.363434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1bea09d1-2209-4317-91f2-aa5844a14dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:37.423518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1260/2535] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:37.432006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664e65-403c-43d0-8147-f3c4536fa0ca None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.432302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664e65-403c-43d0-8147-f3c4536fa0ca None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.432587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664e65-403c-43d0-8147-f3c4536fa0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.452019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-08664e65-403c-43d0-8147-f3c4536fa0ca None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:37.453270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-08664e65-403c-43d0-8147-f3c4536fa0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:37.461470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1276/2536] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:37.465863 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea09d1-2209-4317-91f2-aa5844a14dfa None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:37.477687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea09d1-2209-4317-91f2-aa5844a14dfa None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:37.482370 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:37.483028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.483312 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.483590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.484340 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:41:37.484643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:37.486264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:37.498433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1261/2537] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:41:37.503095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664e65-403c-43d0-8147-f3c4536fa0ca None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:37.513036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664e65-403c-43d0-8147-f3c4536fa0ca None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:37.518319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47de55-46c1-4c46-ac15-2a6c0c4213cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:37.518978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47de55-46c1-4c46-ac15-2a6c0c4213cd admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.519266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47de55-46c1-4c46-ac15-2a6c0c4213cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.519849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47de55-46c1-4c46-ac15-2a6c0c4213cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.520223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47de55-46c1-4c46-ac15-2a6c0c4213cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:37.522486 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47de55-46c1-4c46-ac15-2a6c0c4213cd admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:37.549939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:37.559426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1277/2538] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:41:37 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:41:37.563241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:37.573796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22412-7ed4-4fd6-8205-016c0ddf4add admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:37.635901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc47002-f3e8-47e6-a497-3acd11f18925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:37.636675 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc47002-f3e8-47e6-a497-3acd11f18925 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.636990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc47002-f3e8-47e6-a497-3acd11f18925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.637273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc47002-f3e8-47e6-a497-3acd11f18925 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.637966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc47002-f3e8-47e6-a497-3acd11f18925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:37.639892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc47002-f3e8-47e6-a497-3acd11f18925 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:37.664000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1262/2539] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:41:37 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:41:37.668494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47de55-46c1-4c46-ac15-2a6c0c4213cd admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:37.681520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47de55-46c1-4c46-ac15-2a6c0c4213cd admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:37.687190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ff8c-8cf3-411c-8d3a-4c4bf199954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:37.687848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ff8c-8cf3-411c-8d3a-4c4bf199954b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.688125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ff8c-8cf3-411c-8d3a-4c4bf199954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.688398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ff8c-8cf3-411c-8d3a-4c4bf199954b admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.689146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29ff8c-8cf3-411c-8d3a-4c4bf199954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:37.690737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29ff8c-8cf3-411c-8d3a-4c4bf199954b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:37.704387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1278/2540] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:41:37.708401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc47002-f3e8-47e6-a497-3acd11f18925 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:37.718912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc47002-f3e8-47e6-a497-3acd11f18925 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:37.724153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791db58d-27e4-45e5-83bb-47470bcd26e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:37.725366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db58d-27e4-45e5-83bb-47470bcd26e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.725648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db58d-27e4-45e5-83bb-47470bcd26e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.725921 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db58d-27e4-45e5-83bb-47470bcd26e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.726639 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791db58d-27e4-45e5-83bb-47470bcd26e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:37.728306 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791db58d-27e4-45e5-83bb-47470bcd26e3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:37.738759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1263/2541] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:41:37.743506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ff8c-8cf3-411c-8d3a-4c4bf199954b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:37.754260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ff8c-8cf3-411c-8d3a-4c4bf199954b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:37.759482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:37.760422 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.761173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.761462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] PATH_INFO: `/v3/projects/ec559a9e4b01471296925174799752ca/users/72ba7e1e48df4d319dd472f33da41f2a/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.778215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec559a9e4b01471296925174799752ca, user_id=72ba7e1e48df4d319dd472f33da41f2a, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:37.780967 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:37.795530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1279/2542] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:41:37 2022] PUT /identity/v3/projects/ec559a9e4b01471296925174799752ca/users/72ba7e1e48df4d319dd472f33da41f2a/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:41:37.800671 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872527c-da42-4abb-87e2-ac1a38ece962 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.801275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872527c-da42-4abb-87e2-ac1a38ece962 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.801560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872527c-da42-4abb-87e2-ac1a38ece962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.822049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c872527c-da42-4abb-87e2-ac1a38ece962 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:37.823170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c872527c-da42-4abb-87e2-ac1a38ece962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:37.870917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:37.886851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1264/2543] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:41:37.897631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:37.899836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:37.975689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59bc0f-feee-421b-ad6f-854c5fce7400 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:37.979715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:37.980661 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:37.980983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:37.981273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:37.993119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:37.994753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:38.005965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1280/2544] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:42.638202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10002e0-6e4b-4672-aaa7-4b11ccccf48a None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:42.638662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10002e0-6e4b-4672-aaa7-4b11ccccf48a None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:42.638882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10002e0-6e4b-4672-aaa7-4b11ccccf48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:42.675293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c10002e0-6e4b-4672-aaa7-4b11ccccf48a None None] MFA Rules not processed for user `72ba7e1e48df4d319dd472f33da41f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:42.676606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c10002e0-6e4b-4672-aaa7-4b11ccccf48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:42.751163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1265/2545] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:41:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:41:42.767259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:42.770042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:42.852010 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439937c-d7fc-4f42-a66c-d76640798dc5 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:42.857426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:42.858077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:42.858362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:42.858640 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:42.866601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:42.868207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:42.877146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1281/2546] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:41:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:44.359623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb36594-2bc0-46d7-9543-7c7dc5171e8f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:44.360055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb36594-2bc0-46d7-9543-7c7dc5171e8f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:44.360225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb36594-2bc0-46d7-9543-7c7dc5171e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:44.380768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6bb36594-2bc0-46d7-9543-7c7dc5171e8f None None] MFA Rules not processed for user `72ba7e1e48df4d319dd472f33da41f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:44.382107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6bb36594-2bc0-46d7-9543-7c7dc5171e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:44.394279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1266/2547] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:41:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:44.426933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:44.429154 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:44.496717 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:44.522012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a12b3-bc02-4ffd-9174-aef1c2215739 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:44.525776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:44.526623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:44.526762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:44.526962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:44.528976 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:44.547318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:44.548861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:44.561984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1282/2548] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:41:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:41:45.216404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb36594-2bc0-46d7-9543-7c7dc5171e8f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:45.218421 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6bb36594-2bc0-46d7-9543-7c7dc5171e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:45.234404 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb36594-2bc0-46d7-9543-7c7dc5171e8f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:45.243968 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:45.245713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:45.246240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:45.246743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:45.250465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:45.268568 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:45.270072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:45.285571 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1267/2549] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:41:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:41:54.556201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=12 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:55.278460 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=45 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:57.322812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:57.324203 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:57.338375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133e73-f2aa-4c90-bc94-1d3070832ee1 service glance] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:57.344138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:57.344776 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:57.345090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:57.345373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:57.347057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:57.404399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:57.406058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:57.415693 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1283/2550] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:41:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:07.410864 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=28 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:10.622350 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:10.631693 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415ffd-76a6-46e6-88cf-50fe4a081651 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:10.635291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:10.635932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:10.636219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:10.636501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:10.638329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:10.650727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:10.652152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:10.661670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1268/2551] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:13.979939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.981379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.046478 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.047879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.052012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1226c7-f24c-41e0-9748-e5eb777d2193 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.058000 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.058691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.058981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.059487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.061929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.064503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fc0c7-fdf0-4213-aa03-4d6dc0d3a9e2 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.069680 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.070544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.070826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.071099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] PATH_INFO: `/v3/users/1a3ca370feb4457dbadc476e348ac9ff` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.072387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3ca370feb4457dbadc476e348ac9ff)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.074495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.074617 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.076080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.086121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1284/2552] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:14.125488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3ca370feb4457dbadc476e348ac9ff'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.137560 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3ca370feb4457dbadc476e348ac9ff'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.138224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3ca370feb4457dbadc476e348ac9ff'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.145258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3ca370feb4457dbadc476e348ac9ff'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.145891 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b96f7ea8-9ebd-41fd-8243-77359f663879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3ca370feb4457dbadc476e348ac9ff'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.157914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1269/2553] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:42:14 2022] DELETE /identity/v3/users/1a3ca370feb4457dbadc476e348ac9ff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:14.330922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.345368 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c1b38-63b0-4766-a5cc-9bd6cde2d181 service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.403097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.403965 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.404251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.404527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] PATH_INFO: `/v3/projects/a44df5252ff049338e53726fe7b7cfc0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.405793 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44df5252ff049338e53726fe7b7cfc0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.407783 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.454682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44df5252ff049338e53726fe7b7cfc0', 'request_id': 'req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.460616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44df5252ff049338e53726fe7b7cfc0', 'request_id': 'req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.466600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44df5252ff049338e53726fe7b7cfc0', 'request_id': 'req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.478939 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] The token cache is being invalidate because project a44df5252ff049338e53726fe7b7cfc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:14.479226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.479852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6616ff75-b6b7-42b5-9e3e-1bddffb49c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.481423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1285/2554] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:42:14 2022] DELETE /identity/v3/projects/a44df5252ff049338e53726fe7b7cfc0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:14.486415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6122748-4445-4d03-bcc8-b31e42291af0 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.486706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6122748-4445-4d03-bcc8-b31e42291af0 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.487008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6122748-4445-4d03-bcc8-b31e42291af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.504684 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-b6122748-4445-4d03-bcc8-b31e42291af0 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.506425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b6122748-4445-4d03-bcc8-b31e42291af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.563286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1270/2555] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:14.572049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f151-9346-44b6-9577-50f349a32616 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.572334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f151-9346-44b6-9577-50f349a32616 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.572612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f151-9346-44b6-9577-50f349a32616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.590887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1243f151-9346-44b6-9577-50f349a32616 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.592181 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1243f151-9346-44b6-9577-50f349a32616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.600318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1286/2556] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:14.604243 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6122748-4445-4d03-bcc8-b31e42291af0 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.614230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6122748-4445-4d03-bcc8-b31e42291af0 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.619497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.620291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.620584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.620915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.621658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:14.621970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.623616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.636222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1271/2557] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:42:14.640662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f151-9346-44b6-9577-50f349a32616 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.650524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f151-9346-44b6-9577-50f349a32616 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.655518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4f3f7-30de-4f46-85d7-dcb6938857b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.656182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f3f7-30de-4f46-85d7-dcb6938857b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.656488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f3f7-30de-4f46-85d7-dcb6938857b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.656772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f3f7-30de-4f46-85d7-dcb6938857b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.658153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4f3f7-30de-4f46-85d7-dcb6938857b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.660130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4f3f7-30de-4f46-85d7-dcb6938857b6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.670218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.687621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1287/2558] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:14.691809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.702203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4bf8a-3798-42a1-8d1d-eaf1b31df330 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.749692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.765366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3537d-a219-4af4-9ee6-79e9385f9ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.766042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3537d-a219-4af4-9ee6-79e9385f9ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.766325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3537d-a219-4af4-9ee6-79e9385f9ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.766603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3537d-a219-4af4-9ee6-79e9385f9ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.767286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3537d-a219-4af4-9ee6-79e9385f9ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.769282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3537d-a219-4af4-9ee6-79e9385f9ff3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.791592 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1272/2559] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:14.793018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4f3f7-30de-4f46-85d7-dcb6938857b6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.803979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4f3f7-30de-4f46-85d7-dcb6938857b6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.809201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f11754-655e-4733-badd-03526f79c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.809859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f11754-655e-4733-badd-03526f79c48e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.810145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f11754-655e-4733-badd-03526f79c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.810426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f11754-655e-4733-badd-03526f79c48e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.811145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f11754-655e-4733-badd-03526f79c48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.812765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f11754-655e-4733-badd-03526f79c48e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.823657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1288/2560] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:14.827506 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3537d-a219-4af4-9ee6-79e9385f9ff3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.837504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3537d-a219-4af4-9ee6-79e9385f9ff3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.842386 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d34a1-7a1f-4d06-9b93-2047abfa0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.843011 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d34a1-7a1f-4d06-9b93-2047abfa0102 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.843292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d34a1-7a1f-4d06-9b93-2047abfa0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.843564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d34a1-7a1f-4d06-9b93-2047abfa0102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.844305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d34a1-7a1f-4d06-9b93-2047abfa0102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.845912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d34a1-7a1f-4d06-9b93-2047abfa0102 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.855726 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1273/2561] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:14.859684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f11754-655e-4733-badd-03526f79c48e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.870081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f11754-655e-4733-badd-03526f79c48e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.874752 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae3cd-64c1-4e90-95ca-809b787d917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.875624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae3cd-64c1-4e90-95ca-809b787d917f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.875916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae3cd-64c1-4e90-95ca-809b787d917f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.876191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae3cd-64c1-4e90-95ca-809b787d917f admin admin] PATH_INFO: `/v3/projects/a59409c47e094555af99e9c40d5d6067/users/19e88f7055ae4067a1d915da82901a99/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.891130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ae3cd-64c1-4e90-95ca-809b787d917f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59409c47e094555af99e9c40d5d6067, user_id=19e88f7055ae4067a1d915da82901a99, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.893981 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ae3cd-64c1-4e90-95ca-809b787d917f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.907436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1289/2562] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:14 2022] PUT /identity/v3/projects/a59409c47e094555af99e9c40d5d6067/users/19e88f7055ae4067a1d915da82901a99/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:14.917916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad25d3-2173-4119-969f-ecf4e8d8ab58 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.918212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad25d3-2173-4119-969f-ecf4e8d8ab58 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.918499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad25d3-2173-4119-969f-ecf4e8d8ab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.944623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-93ad25d3-2173-4119-969f-ecf4e8d8ab58 None None] MFA Rules not processed for user `19e88f7055ae4067a1d915da82901a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.945849 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-93ad25d3-2173-4119-969f-ecf4e8d8ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:15.008514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1274/2563] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:15.013720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae3cd-64c1-4e90-95ca-809b787d917f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.073881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae3cd-64c1-4e90-95ca-809b787d917f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.078541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609b0b9-a5f2-458a-9c4b-8156b4338d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.079213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609b0b9-a5f2-458a-9c4b-8156b4338d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.079496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609b0b9-a5f2-458a-9c4b-8156b4338d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.079774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609b0b9-a5f2-458a-9c4b-8156b4338d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.080460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609b0b9-a5f2-458a-9c4b-8156b4338d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.082399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609b0b9-a5f2-458a-9c4b-8156b4338d16 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.108185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1290/2564] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:42:15 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:15.112086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad25d3-2173-4119-969f-ecf4e8d8ab58 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.123358 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad25d3-2173-4119-969f-ecf4e8d8ab58 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.177424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a958c-e172-4561-b51c-1215e7657768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.178624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a958c-e172-4561-b51c-1215e7657768 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.178911 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a958c-e172-4561-b51c-1215e7657768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.179195 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a958c-e172-4561-b51c-1215e7657768 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.179888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a958c-e172-4561-b51c-1215e7657768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.181833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a958c-e172-4561-b51c-1215e7657768 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.208634 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1275/2565] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:42:15 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:15.210059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609b0b9-a5f2-458a-9c4b-8156b4338d16 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.220866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609b0b9-a5f2-458a-9c4b-8156b4338d16 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.225985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879c08-ef55-4c67-b915-c0b7bc359717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.226636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879c08-ef55-4c67-b915-c0b7bc359717 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.226918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879c08-ef55-4c67-b915-c0b7bc359717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.227198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879c08-ef55-4c67-b915-c0b7bc359717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.227913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41879c08-ef55-4c67-b915-c0b7bc359717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.229566 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41879c08-ef55-4c67-b915-c0b7bc359717 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.239829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1291/2566] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:15.244299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a958c-e172-4561-b51c-1215e7657768 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.254240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a958c-e172-4561-b51c-1215e7657768 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.258864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec62e68-8416-423b-b434-58802bdff1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.259734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec62e68-8416-423b-b434-58802bdff1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.260017 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec62e68-8416-423b-b434-58802bdff1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.260295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec62e68-8416-423b-b434-58802bdff1f3 admin admin] PATH_INFO: `/v3/projects/e5ba50460606470cb56a688823842784/users/79d5a2fa815541efbbf3fa8ec2f48425/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.275299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec62e68-8416-423b-b434-58802bdff1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ba50460606470cb56a688823842784, user_id=79d5a2fa815541efbbf3fa8ec2f48425, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.278058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec62e68-8416-423b-b434-58802bdff1f3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.291902 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1276/2567] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:15 2022] PUT /identity/v3/projects/e5ba50460606470cb56a688823842784/users/79d5a2fa815541efbbf3fa8ec2f48425/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:15.295706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879c08-ef55-4c67-b915-c0b7bc359717 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.306024 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879c08-ef55-4c67-b915-c0b7bc359717 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.361277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436484e8-0c73-4ef7-801c-73049a8e31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.361875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436484e8-0c73-4ef7-801c-73049a8e31c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.362146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436484e8-0c73-4ef7-801c-73049a8e31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.362419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436484e8-0c73-4ef7-801c-73049a8e31c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.363119 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436484e8-0c73-4ef7-801c-73049a8e31c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.364708 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436484e8-0c73-4ef7-801c-73049a8e31c2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.374056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1292/2568] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:15.378242 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec62e68-8416-423b-b434-58802bdff1f3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.388305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec62e68-8416-423b-b434-58802bdff1f3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.392908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.393779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.394055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.394331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] PATH_INFO: `/v3/projects/e5ba50460606470cb56a688823842784/users/79d5a2fa815541efbbf3fa8ec2f48425/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.396290 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ba50460606470cb56a688823842784, user_id=79d5a2fa815541efbbf3fa8ec2f48425, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.399453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.409480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1277/2569] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:15 2022] PUT /identity/v3/projects/e5ba50460606470cb56a688823842784/users/79d5a2fa815541efbbf3fa8ec2f48425/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:15.420190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574cac1-833c-4d05-8fa0-c1ca754dbb82 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.420488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574cac1-833c-4d05-8fa0-c1ca754dbb82 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.420779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574cac1-833c-4d05-8fa0-c1ca754dbb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.447493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c574cac1-833c-4d05-8fa0-c1ca754dbb82 None None] MFA Rules not processed for user `79d5a2fa815541efbbf3fa8ec2f48425`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:15.448733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c574cac1-833c-4d05-8fa0-c1ca754dbb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:15.461906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:15.516127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1293/2570] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:15.528487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.530189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:15.540327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:15.587012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae8299-7806-446b-a16d-f18f1f6b9252 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.590663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dfe1a-4763-412b-ae47-0ef63d3d309a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.591300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dfe1a-4763-412b-ae47-0ef63d3d309a service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.591578 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dfe1a-4763-412b-ae47-0ef63d3d309a service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.591851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4dfe1a-4763-412b-ae47-0ef63d3d309a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.601523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dfe1a-4763-412b-ae47-0ef63d3d309a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.602938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4dfe1a-4763-412b-ae47-0ef63d3d309a service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.612221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1278/2571] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:15.682919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574cac1-833c-4d05-8fa0-c1ca754dbb82 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.692513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574cac1-833c-4d05-8fa0-c1ca754dbb82 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.696603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b92c3-b2c8-44fc-bdca-55d0f349351a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.697272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b92c3-b2c8-44fc-bdca-55d0f349351a service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.697557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b92c3-b2c8-44fc-bdca-55d0f349351a service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.697831 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b92c3-b2c8-44fc-bdca-55d0f349351a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.752525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b92c3-b2c8-44fc-bdca-55d0f349351a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.753994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b92c3-b2c8-44fc-bdca-55d0f349351a service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.763235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1294/2572] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:25.608103 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=23 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:25.759216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=50 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:44.579501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dfe1a-4763-412b-ae47-0ef63d3d309a service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:44.640865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4dfe1a-4763-412b-ae47-0ef63d3d309a service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:44.645537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:44.646442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.646729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.647006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] PATH_INFO: `/v3/users/19e88f7055ae4067a1d915da82901a99` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.648202 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e88f7055ae4067a1d915da82901a99)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:44.650160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:44.694612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e88f7055ae4067a1d915da82901a99'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:44.706045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e88f7055ae4067a1d915da82901a99'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:44.706692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e88f7055ae4067a1d915da82901a99'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:44.713476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e88f7055ae4067a1d915da82901a99'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:44.714086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e88f7055ae4067a1d915da82901a99'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:44.727246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1279/2573] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:42:44 2022] DELETE /identity/v3/users/19e88f7055ae4067a1d915da82901a99 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:44.731723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502400fd-72e0-498b-aa3b-6530f6c8e330 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.732226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502400fd-72e0-498b-aa3b-6530f6c8e330 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.732338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502400fd-72e0-498b-aa3b-6530f6c8e330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.750535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-502400fd-72e0-498b-aa3b-6530f6c8e330 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:44.751743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-502400fd-72e0-498b-aa3b-6530f6c8e330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:44.809381 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1295/2574] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:44.819156 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:44.820575 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:44.877305 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3122b02-7809-477a-b53f-448f4aedcd95 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:44.881015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326df35-969e-4b34-879d-6cd634083b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:44.881660 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326df35-969e-4b34-879d-6cd634083b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:44.881944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326df35-969e-4b34-879d-6cd634083b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:44.882228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326df35-969e-4b34-879d-6cd634083b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:44.891108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326df35-969e-4b34-879d-6cd634083b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:44.892534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326df35-969e-4b34-879d-6cd634083b0e service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:44.902486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1280/2575] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:45.405778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502400fd-72e0-498b-aa3b-6530f6c8e330 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.407576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-502400fd-72e0-498b-aa3b-6530f6c8e330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:45.422428 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502400fd-72e0-498b-aa3b-6530f6c8e330 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:45.427951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:45.428811 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.429186 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.429399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] PATH_INFO: `/v3/projects/a59409c47e094555af99e9c40d5d6067` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.430669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59409c47e094555af99e9c40d5d6067)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:45.432525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:45.478903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59409c47e094555af99e9c40d5d6067', 'request_id': 'req-eb1108a3-5bfa-4713-baf8-cc0e26379cee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.484362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59409c47e094555af99e9c40d5d6067', 'request_id': 'req-eb1108a3-5bfa-4713-baf8-cc0e26379cee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.490358 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59409c47e094555af99e9c40d5d6067', 'request_id': 'req-eb1108a3-5bfa-4713-baf8-cc0e26379cee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.503033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] The token cache is being invalidate because project a59409c47e094555af99e9c40d5d6067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:45.503484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.504497 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.507337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1296/2576] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:42:45 2022] DELETE /identity/v3/projects/a59409c47e094555af99e9c40d5d6067 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:45.511608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326df35-969e-4b34-879d-6cd634083b0e service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.522257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326df35-969e-4b34-879d-6cd634083b0e service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:45.540297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:45.580150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:45.580966 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:45.581247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:45.581521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] PATH_INFO: `/v3/users/79d5a2fa815541efbbf3fa8ec2f48425` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:45.582711 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d5a2fa815541efbbf3fa8ec2f48425)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:45.585473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:45.637038 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d5a2fa815541efbbf3fa8ec2f48425'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.650388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d5a2fa815541efbbf3fa8ec2f48425'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.651097 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d5a2fa815541efbbf3fa8ec2f48425'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.658727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d5a2fa815541efbbf3fa8ec2f48425'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.659769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b085138b-599d-4d82-8896-effc4ef00396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d5a2fa815541efbbf3fa8ec2f48425'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:45.672394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1281/2577] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:42:45 2022] DELETE /identity/v3/users/79d5a2fa815541efbbf3fa8ec2f48425 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:45.940799 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:45.942298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:45.956038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1108a3-5bfa-4713-baf8-cc0e26379cee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.012595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.013489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.013770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.014046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] PATH_INFO: `/v3/projects/e5ba50460606470cb56a688823842784` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.015209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ba50460606470cb56a688823842784)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.017362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.047726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:46.065525 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ba50460606470cb56a688823842784', 'request_id': 'req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:46.071077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ba50460606470cb56a688823842784', 'request_id': 'req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:46.077189 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ba50460606470cb56a688823842784', 'request_id': 'req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:46.089096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] The token cache is being invalidate because project e5ba50460606470cb56a688823842784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:46.089385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:46.090014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-13c9b600-3e8e-4f1f-9e57-24f8ab753bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:46.091543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1297/2578] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:42:45 2022] DELETE /identity/v3/projects/e5ba50460606470cb56a688823842784 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:46.096843 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd928c-1452-4060-b466-d64b557df037 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.097139 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd928c-1452-4060-b466-d64b557df037 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.097424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd928c-1452-4060-b466-d64b557df037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.115770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-39dd928c-1452-4060-b466-d64b557df037 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:46.117064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-39dd928c-1452-4060-b466-d64b557df037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:46.176288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1282/2579] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:46.185057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94cbb6-8196-4948-af9a-825650ad265c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.185447 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94cbb6-8196-4948-af9a-825650ad265c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.185763 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94cbb6-8196-4948-af9a-825650ad265c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.204083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bd94cbb6-8196-4948-af9a-825650ad265c None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:46.205333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bd94cbb6-8196-4948-af9a-825650ad265c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:46.213199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1298/2580] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:46.217643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd928c-1452-4060-b466-d64b557df037 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.227750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd928c-1452-4060-b466-d64b557df037 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.232291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.232974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.233261 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.233539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.234258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:46.234561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.236140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.247892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1283/2581] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:42:46.251899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94cbb6-8196-4948-af9a-825650ad265c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.261143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94cbb6-8196-4948-af9a-825650ad265c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.266043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f56d0-a7a0-47eb-925a-089633b42719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.266692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f56d0-a7a0-47eb-925a-089633b42719 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.266978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f56d0-a7a0-47eb-925a-089633b42719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.267259 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f56d0-a7a0-47eb-925a-089633b42719 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.267945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f56d0-a7a0-47eb-925a-089633b42719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.269974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f56d0-a7a0-47eb-925a-089633b42719 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.306124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1299/2582] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:42:46 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:46.310191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.320019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4bafd-3002-48d8-b362-7ad8c4707332 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.345089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:46.376629 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1c02f-b003-49b5-9b7c-a7b62bc00c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.377303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c02f-b003-49b5-9b7c-a7b62bc00c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.377586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c02f-b003-49b5-9b7c-a7b62bc00c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.377862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c02f-b003-49b5-9b7c-a7b62bc00c75 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.378543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c02f-b003-49b5-9b7c-a7b62bc00c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.380451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c02f-b003-49b5-9b7c-a7b62bc00c75 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.400176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1284/2583] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:42:46 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:46.404372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f56d0-a7a0-47eb-925a-089633b42719 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.415364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f56d0-a7a0-47eb-925a-089633b42719 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.420070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed2dd-630e-4921-9b3b-cbd6e73f9486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.420722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed2dd-630e-4921-9b3b-cbd6e73f9486 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.421061 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed2dd-630e-4921-9b3b-cbd6e73f9486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.421322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed2dd-630e-4921-9b3b-cbd6e73f9486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.422040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ed2dd-630e-4921-9b3b-cbd6e73f9486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.423646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ed2dd-630e-4921-9b3b-cbd6e73f9486 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.433416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1300/2584] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:46.437344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1c02f-b003-49b5-9b7c-a7b62bc00c75 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.447920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1c02f-b003-49b5-9b7c-a7b62bc00c75 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.452553 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd221ca8-3563-4ebb-9b1b-e2bb4d25939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.453239 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221ca8-3563-4ebb-9b1b-e2bb4d25939f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.453524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221ca8-3563-4ebb-9b1b-e2bb4d25939f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.453802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221ca8-3563-4ebb-9b1b-e2bb4d25939f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.454630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd221ca8-3563-4ebb-9b1b-e2bb4d25939f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.456212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd221ca8-3563-4ebb-9b1b-e2bb4d25939f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.466678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1285/2585] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:46.471093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed2dd-630e-4921-9b3b-cbd6e73f9486 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.481695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed2dd-630e-4921-9b3b-cbd6e73f9486 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.486294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede700d9-7d2b-48ca-8b6b-da2e6ed625a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.487158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede700d9-7d2b-48ca-8b6b-da2e6ed625a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.487437 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede700d9-7d2b-48ca-8b6b-da2e6ed625a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.487724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede700d9-7d2b-48ca-8b6b-da2e6ed625a3 admin admin] PATH_INFO: `/v3/projects/bc1fad30907f48cdb59b5bd9a9f90842/users/bc6323cbc96d47cf9d2741008f234491/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.501993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede700d9-7d2b-48ca-8b6b-da2e6ed625a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1fad30907f48cdb59b5bd9a9f90842, user_id=bc6323cbc96d47cf9d2741008f234491, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.504713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede700d9-7d2b-48ca-8b6b-da2e6ed625a3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.517419 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1301/2586] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:46 2022] PUT /identity/v3/projects/bc1fad30907f48cdb59b5bd9a9f90842/users/bc6323cbc96d47cf9d2741008f234491/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:46.527915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6335cf-6dcb-44c5-bff0-f11f6e42d113 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.528214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6335cf-6dcb-44c5-bff0-f11f6e42d113 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.528529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6335cf-6dcb-44c5-bff0-f11f6e42d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.555364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4e6335cf-6dcb-44c5-bff0-f11f6e42d113 None None] MFA Rules not processed for user `bc6323cbc96d47cf9d2741008f234491`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:46.556586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4e6335cf-6dcb-44c5-bff0-f11f6e42d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:46.620137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1286/2587] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:46.624473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede700d9-7d2b-48ca-8b6b-da2e6ed625a3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.686005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede700d9-7d2b-48ca-8b6b-da2e6ed625a3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.691054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab41bce-e2cf-47a2-898f-a01e0d88b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.691713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41bce-e2cf-47a2-898f-a01e0d88b0ae admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.691997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41bce-e2cf-47a2-898f-a01e0d88b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.692273 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41bce-e2cf-47a2-898f-a01e0d88b0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.692998 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab41bce-e2cf-47a2-898f-a01e0d88b0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.695015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab41bce-e2cf-47a2-898f-a01e0d88b0ae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.721438 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1302/2588] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:42:46 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:46.726089 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6335cf-6dcb-44c5-bff0-f11f6e42d113 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.737171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6335cf-6dcb-44c5-bff0-f11f6e42d113 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.794672 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d079d-2608-4653-a068-baa2f171dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.795435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d079d-2608-4653-a068-baa2f171dc19 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.795791 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d079d-2608-4653-a068-baa2f171dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.796074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d079d-2608-4653-a068-baa2f171dc19 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.796763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d079d-2608-4653-a068-baa2f171dc19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.798701 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d079d-2608-4653-a068-baa2f171dc19 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.823040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1287/2589] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:42:46 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:46.824295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab41bce-e2cf-47a2-898f-a01e0d88b0ae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.835123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab41bce-e2cf-47a2-898f-a01e0d88b0ae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.840089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad81ad-c7ff-4adf-bc01-9355f0e5db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.840750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad81ad-c7ff-4adf-bc01-9355f0e5db97 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.841056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad81ad-c7ff-4adf-bc01-9355f0e5db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.841328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad81ad-c7ff-4adf-bc01-9355f0e5db97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.842294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad81ad-c7ff-4adf-bc01-9355f0e5db97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.843881 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad81ad-c7ff-4adf-bc01-9355f0e5db97 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.855396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1303/2590] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:46.859477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d079d-2608-4653-a068-baa2f171dc19 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.869343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d079d-2608-4653-a068-baa2f171dc19 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.873935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734c035-26fb-48b7-80b6-4d8571753c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.874819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734c035-26fb-48b7-80b6-4d8571753c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.875104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734c035-26fb-48b7-80b6-4d8571753c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.875385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734c035-26fb-48b7-80b6-4d8571753c63 admin admin] PATH_INFO: `/v3/projects/43d688e59fd6448c8553ff7a043a6eae/users/023c23d69f7d4cf1be1e9f3ce90058ed/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.890329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734c035-26fb-48b7-80b6-4d8571753c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d688e59fd6448c8553ff7a043a6eae, user_id=023c23d69f7d4cf1be1e9f3ce90058ed, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.893016 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734c035-26fb-48b7-80b6-4d8571753c63 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.906555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1288/2591] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:46 2022] PUT /identity/v3/projects/43d688e59fd6448c8553ff7a043a6eae/users/023c23d69f7d4cf1be1e9f3ce90058ed/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:46.910620 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad81ad-c7ff-4adf-bc01-9355f0e5db97 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:46.920560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad81ad-c7ff-4adf-bc01-9355f0e5db97 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:46.931778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:46.978993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117457de-216f-44dd-bb6f-fa82426495e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:46.979591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117457de-216f-44dd-bb6f-fa82426495e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:46.979854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117457de-216f-44dd-bb6f-fa82426495e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:46.980132 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117457de-216f-44dd-bb6f-fa82426495e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:46.980948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117457de-216f-44dd-bb6f-fa82426495e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:46.982631 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117457de-216f-44dd-bb6f-fa82426495e5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:46.992289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1304/2592] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:46.996390 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734c035-26fb-48b7-80b6-4d8571753c63 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:47.002007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:47.008782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734c035-26fb-48b7-80b6-4d8571753c63 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:47.013689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:47.014565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:47.014844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:47.015118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] PATH_INFO: `/v3/projects/43d688e59fd6448c8553ff7a043a6eae/users/023c23d69f7d4cf1be1e9f3ce90058ed/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:47.017113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d688e59fd6448c8553ff7a043a6eae, user_id=023c23d69f7d4cf1be1e9f3ce90058ed, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:47.019744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:47.030432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1289/2593] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:46 2022] PUT /identity/v3/projects/43d688e59fd6448c8553ff7a043a6eae/users/023c23d69f7d4cf1be1e9f3ce90058ed/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:47.041249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8e142-06df-45c2-8d1d-93b3b7fd48fd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:47.041539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8e142-06df-45c2-8d1d-93b3b7fd48fd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:47.041821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8e142-06df-45c2-8d1d-93b3b7fd48fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:47.067139 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4ef8e142-06df-45c2-8d1d-93b3b7fd48fd None None] MFA Rules not processed for user `023c23d69f7d4cf1be1e9f3ce90058ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:47.068890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4ef8e142-06df-45c2-8d1d-93b3b7fd48fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:47.135485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1305/2594] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:47.146472 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:47.148762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:47.205984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd001c2-45a2-4290-9f43-67d25568c2a1 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:47.209703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc94c-0e9d-466f-af6f-05cdcac07e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:47.210347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc94c-0e9d-466f-af6f-05cdcac07e7e service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:47.210632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc94c-0e9d-466f-af6f-05cdcac07e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:47.210912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc94c-0e9d-466f-af6f-05cdcac07e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:47.220101 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbc94c-0e9d-466f-af6f-05cdcac07e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:47.221583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbc94c-0e9d-466f-af6f-05cdcac07e7e service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:47.231333 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1290/2595] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:47.310592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8e142-06df-45c2-8d1d-93b3b7fd48fd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:47.320938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8e142-06df-45c2-8d1d-93b3b7fd48fd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:47.324539 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b46a7-b9df-4e34-a2a0-016663926efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:47.325210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b46a7-b9df-4e34-a2a0-016663926efd service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:47.325489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b46a7-b9df-4e34-a2a0-016663926efd service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:47.325764 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b46a7-b9df-4e34-a2a0-016663926efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:47.380498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b46a7-b9df-4e34-a2a0-016663926efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:47.382503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b46a7-b9df-4e34-a2a0-016663926efd service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:47.391848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1306/2596] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:50.069469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc94c-0e9d-466f-af6f-05cdcac07e7e service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:50.131455 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc94c-0e9d-466f-af6f-05cdcac07e7e service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:50.135956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:50.136861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:50.137136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:50.137409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] PATH_INFO: `/v3/users/bc6323cbc96d47cf9d2741008f234491` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:50.138613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6323cbc96d47cf9d2741008f234491)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:50.140563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:50.187461 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6323cbc96d47cf9d2741008f234491'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.200882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6323cbc96d47cf9d2741008f234491'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.201613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6323cbc96d47cf9d2741008f234491'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.211433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6323cbc96d47cf9d2741008f234491'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.212076 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6323cbc96d47cf9d2741008f234491'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.227459 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1291/2597] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:42:50 2022] DELETE /identity/v3/users/bc6323cbc96d47cf9d2741008f234491 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:50.231667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc7f0d-829d-4e35-8a25-1edcb501df84 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:50.232156 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc7f0d-829d-4e35-8a25-1edcb501df84 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:50.232240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc7f0d-829d-4e35-8a25-1edcb501df84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:50.251618 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fbbc7f0d-829d-4e35-8a25-1edcb501df84 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:50.252859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fbbc7f0d-829d-4e35-8a25-1edcb501df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:50.288909 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:50.325587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1307/2598] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:50.336091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:50.337857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:50.355612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:50.404572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929511-c0f9-4a69-a7fc-13eea90cb35e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:50.408203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419878-221f-43cf-8b37-621708c53fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:50.408875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419878-221f-43cf-8b37-621708c53fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:50.409158 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419878-221f-43cf-8b37-621708c53fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:50.409433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419878-221f-43cf-8b37-621708c53fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:50.418989 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419878-221f-43cf-8b37-621708c53fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:50.420412 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419878-221f-43cf-8b37-621708c53fb0 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:50.429724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1292/2599] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:50.691839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc7f0d-829d-4e35-8a25-1edcb501df84 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:50.693877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fbbc7f0d-829d-4e35-8a25-1edcb501df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:50.707743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc7f0d-829d-4e35-8a25-1edcb501df84 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:50.712874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:50.713821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:50.714193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:50.714538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] PATH_INFO: `/v3/projects/bc1fad30907f48cdb59b5bd9a9f90842` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:50.715787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1fad30907f48cdb59b5bd9a9f90842)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:50.718961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:50.766553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1fad30907f48cdb59b5bd9a9f90842', 'request_id': 'req-03cd1f01-87d0-47d7-976f-9c56bf965c90'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.772124 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1fad30907f48cdb59b5bd9a9f90842', 'request_id': 'req-03cd1f01-87d0-47d7-976f-9c56bf965c90'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.778366 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1fad30907f48cdb59b5bd9a9f90842', 'request_id': 'req-03cd1f01-87d0-47d7-976f-9c56bf965c90'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.790362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] The token cache is being invalidate because project bc1fad30907f48cdb59b5bd9a9f90842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:50.790652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.791283 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.792855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1308/2600] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:42:50 2022] DELETE /identity/v3/projects/bc1fad30907f48cdb59b5bd9a9f90842 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:50.796853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419878-221f-43cf-8b37-621708c53fb0 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:50.807226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419878-221f-43cf-8b37-621708c53fb0 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:50.860980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:50.861846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:50.862128 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:50.862401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] PATH_INFO: `/v3/users/023c23d69f7d4cf1be1e9f3ce90058ed` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:50.863581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=023c23d69f7d4cf1be1e9f3ce90058ed)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:50.866137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:50.908353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023c23d69f7d4cf1be1e9f3ce90058ed'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.920229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023c23d69f7d4cf1be1e9f3ce90058ed'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.920884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023c23d69f7d4cf1be1e9f3ce90058ed'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.927753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023c23d69f7d4cf1be1e9f3ce90058ed'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.928362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4745e44c-7604-4449-ac03-949138effa67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023c23d69f7d4cf1be1e9f3ce90058ed'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:50.940113 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1293/2601] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:42:50 2022] DELETE /identity/v3/users/023c23d69f7d4cf1be1e9f3ce90058ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:51.217272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.218724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:51.237934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1f01-87d0-47d7-976f-9c56bf965c90 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:51.293815 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:51.294689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.294969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.295242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] PATH_INFO: `/v3/projects/43d688e59fd6448c8553ff7a043a6eae` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.296451 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d688e59fd6448c8553ff7a043a6eae)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:51.298434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:51.352812 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d688e59fd6448c8553ff7a043a6eae', 'request_id': 'req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:51.358425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d688e59fd6448c8553ff7a043a6eae', 'request_id': 'req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:51.360309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:51.365983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d688e59fd6448c8553ff7a043a6eae', 'request_id': 'req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:51.381173 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] The token cache is being invalidate because project 43d688e59fd6448c8553ff7a043a6eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:51.381464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:51.382089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ec93b50e-15c1-4cf0-ac8b-4d8048992eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:51.383645 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1309/2602] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:42:51 2022] DELETE /identity/v3/projects/43d688e59fd6448c8553ff7a043a6eae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:51.388434 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fda7-cd95-47c2-a2cd-8cc8c04ac849 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.388930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fda7-cd95-47c2-a2cd-8cc8c04ac849 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.389030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351fda7-cd95-47c2-a2cd-8cc8c04ac849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.410519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-e351fda7-cd95-47c2-a2cd-8cc8c04ac849 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:51.410519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e351fda7-cd95-47c2-a2cd-8cc8c04ac849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:51.440547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:51.484970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1294/2603] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:51.488263 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179689e-0fa7-4874-8a68-03b16c94e80a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.488498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179689e-0fa7-4874-8a68-03b16c94e80a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.488798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179689e-0fa7-4874-8a68-03b16c94e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.508403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c179689e-0fa7-4874-8a68-03b16c94e80a None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:51.509672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c179689e-0fa7-4874-8a68-03b16c94e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:51.525017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1310/2604] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:51.528663 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351fda7-cd95-47c2-a2cd-8cc8c04ac849 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.539218 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351fda7-cd95-47c2-a2cd-8cc8c04ac849 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:51.544761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451f004-3161-4301-9e91-a10d67987123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:51.545523 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451f004-3161-4301-9e91-a10d67987123 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.545879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451f004-3161-4301-9e91-a10d67987123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.546229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451f004-3161-4301-9e91-a10d67987123 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.547152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451f004-3161-4301-9e91-a10d67987123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:51.547524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451f004-3161-4301-9e91-a10d67987123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:51.549488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451f004-3161-4301-9e91-a10d67987123 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:51.562310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1295/2605] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:42:51.566690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179689e-0fa7-4874-8a68-03b16c94e80a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.581241 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179689e-0fa7-4874-8a68-03b16c94e80a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:51.589400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea1f81-e715-4959-936a-c34053eb0388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:51.590703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea1f81-e715-4959-936a-c34053eb0388 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.590703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea1f81-e715-4959-936a-c34053eb0388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.590703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea1f81-e715-4959-936a-c34053eb0388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.592262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea1f81-e715-4959-936a-c34053eb0388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:51.593522 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea1f81-e715-4959-936a-c34053eb0388 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:51.597479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2f62-f783-4291-9721-d6a50ee8ca97 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.597781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2f62-f783-4291-9721-d6a50ee8ca97 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.598045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2f62-f783-4291-9721-d6a50ee8ca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.615514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-1fca2f62-f783-4291-9721-d6a50ee8ca97 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:51.616754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1fca2f62-f783-4291-9721-d6a50ee8ca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:51.623563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1311/2606] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:42:51 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:51.624853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea1f81-e715-4959-936a-c34053eb0388 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.678108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1296/2607] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:51.696111 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea1f81-e715-4959-936a-c34053eb0388 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:51.700798 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf2f43-5087-4af1-9854-2b95b9fd2927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:51.701737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2f43-5087-4af1-9854-2b95b9fd2927 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.701835 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2f43-5087-4af1-9854-2b95b9fd2927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.702088 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2f43-5087-4af1-9854-2b95b9fd2927 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.702781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf2f43-5087-4af1-9854-2b95b9fd2927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:51.704727 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf2f43-5087-4af1-9854-2b95b9fd2927 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:51.725591 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1312/2608] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:42:51 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:51.726049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca2f62-f783-4291-9721-d6a50ee8ca97 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.727573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-1fca2f62-f783-4291-9721-d6a50ee8ca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:51.729436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf2f43-5087-4af1-9854-2b95b9fd2927 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.739441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf2f43-5087-4af1-9854-2b95b9fd2927 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:51.744899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86c66-e82b-40be-98ae-5347f703090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:51.745582 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86c66-e82b-40be-98ae-5347f703090e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.745876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86c66-e82b-40be-98ae-5347f703090e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.746144 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86c66-e82b-40be-98ae-5347f703090e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.746883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c86c66-e82b-40be-98ae-5347f703090e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:51.748469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c86c66-e82b-40be-98ae-5347f703090e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:51.759183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1313/2609] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:51.763009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86c66-e82b-40be-98ae-5347f703090e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.777309 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86c66-e82b-40be-98ae-5347f703090e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:51.783328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9642-5667-4a9f-a2d1-09c7cadfa883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:51.784004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9642-5667-4a9f-a2d1-09c7cadfa883 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.784276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9642-5667-4a9f-a2d1-09c7cadfa883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.784553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9642-5667-4a9f-a2d1-09c7cadfa883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.785316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe9642-5667-4a9f-a2d1-09c7cadfa883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:51.786943 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe9642-5667-4a9f-a2d1-09c7cadfa883 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:51.796924 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1314/2610] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:51.801013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9642-5667-4a9f-a2d1-09c7cadfa883 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.810837 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9642-5667-4a9f-a2d1-09c7cadfa883 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:51.815425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48f52-4c25-42b2-aaa7-ccb584efaa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:51.816263 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48f52-4c25-42b2-aaa7-ccb584efaa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.816543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48f52-4c25-42b2-aaa7-ccb584efaa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.816816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48f52-4c25-42b2-aaa7-ccb584efaa37 admin admin] PATH_INFO: `/v3/projects/8bb064dee7324d43b61717519fe14e1b/users/e6ca79632ffd41629cc4e2234a0f1d4a/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.819917 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca2f62-f783-4291-9721-d6a50ee8ca97 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:51.831983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48f52-4c25-42b2-aaa7-ccb584efaa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb064dee7324d43b61717519fe14e1b, user_id=e6ca79632ffd41629cc4e2234a0f1d4a, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:51.834712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48f52-4c25-42b2-aaa7-ccb584efaa37 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:51.848098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1315/2611] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:51 2022] PUT /identity/v3/projects/8bb064dee7324d43b61717519fe14e1b/users/e6ca79632ffd41629cc4e2234a0f1d4a/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:51.859745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca06565-14a2-47eb-9713-fc7b1e3b0a8f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.860415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca06565-14a2-47eb-9713-fc7b1e3b0a8f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.860680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca06565-14a2-47eb-9713-fc7b1e3b0a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.871357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:51.881546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729d2ec-f1b5-4f63-9aa6-f3df338c9b23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:51.882807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729d2ec-f1b5-4f63-9aa6-f3df338c9b23 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.883092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729d2ec-f1b5-4f63-9aa6-f3df338c9b23 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.883373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729d2ec-f1b5-4f63-9aa6-f3df338c9b23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:51.888333 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5ca06565-14a2-47eb-9713-fc7b1e3b0a8f None None] MFA Rules not processed for user `e6ca79632ffd41629cc4e2234a0f1d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:51.889688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5ca06565-14a2-47eb-9713-fc7b1e3b0a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:51.938817 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729d2ec-f1b5-4f63-9aa6-f3df338c9b23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:51.940426 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729d2ec-f1b5-4f63-9aa6-f3df338c9b23 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:51.943654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:51.949888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1297/2612] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:42:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:42:51.955383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1316/2613] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:51.959880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729d2ec-f1b5-4f63-9aa6-f3df338c9b23 service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:51.970581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729d2ec-f1b5-4f63-9aa6-f3df338c9b23 service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.038024 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329be0c-2787-4baa-b713-94bca11e5f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.038746 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329be0c-2787-4baa-b713-94bca11e5f1d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.039015 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329be0c-2787-4baa-b713-94bca11e5f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.039295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329be0c-2787-4baa-b713-94bca11e5f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.040018 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329be0c-2787-4baa-b713-94bca11e5f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.042188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329be0c-2787-4baa-b713-94bca11e5f1d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.074429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1298/2614] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:42:51 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:52.075593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca06565-14a2-47eb-9713-fc7b1e3b0a8f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.086988 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca06565-14a2-47eb-9713-fc7b1e3b0a8f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.186972 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfb30d-8654-4848-afd6-55a6def4cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.188101 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfb30d-8654-4848-afd6-55a6def4cc92 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.188232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfb30d-8654-4848-afd6-55a6def4cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.188915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfb30d-8654-4848-afd6-55a6def4cc92 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.189518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfb30d-8654-4848-afd6-55a6def4cc92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.193097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfb30d-8654-4848-afd6-55a6def4cc92 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.226153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1317/2615] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:42:52 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:42:52.227491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329be0c-2787-4baa-b713-94bca11e5f1d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.245496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329be0c-2787-4baa-b713-94bca11e5f1d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.258302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.259034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.259330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.259644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.260441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.264712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.291705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1299/2616] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:52.298913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfb30d-8654-4848-afd6-55a6def4cc92 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.311570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.313769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.321678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfb30d-8654-4848-afd6-55a6def4cc92 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.337453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8100e-a814-4006-9026-58a83c423929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.338541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8100e-a814-4006-9026-58a83c423929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.338917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8100e-a814-4006-9026-58a83c423929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.339468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8100e-a814-4006-9026-58a83c423929 admin admin] PATH_INFO: `/v3/projects/2cacd88ac4e347818b4ba68f9e92b8e3/users/74aa0c9f81064dbfa695826e9267429d/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.363966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8100e-a814-4006-9026-58a83c423929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cacd88ac4e347818b4ba68f9e92b8e3, user_id=74aa0c9f81064dbfa695826e9267429d, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.368123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8100e-a814-4006-9026-58a83c423929 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.388272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1318/2617] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:52 2022] PUT /identity/v3/projects/2cacd88ac4e347818b4ba68f9e92b8e3/users/74aa0c9f81064dbfa695826e9267429d/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:52.398434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8100e-a814-4006-9026-58a83c423929 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.434888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a434-6b93-447d-931d-ba464c058f19 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.445055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:52.490935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8100e-a814-4006-9026-58a83c423929 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.500199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2dfca-ffb9-47d2-81ce-e5c6a0dd0a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.501081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2dfca-ffb9-47d2-81ce-e5c6a0dd0a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.501384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2dfca-ffb9-47d2-81ce-e5c6a0dd0a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.501807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2dfca-ffb9-47d2-81ce-e5c6a0dd0a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.502731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2dfca-ffb9-47d2-81ce-e5c6a0dd0a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.504491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2dfca-ffb9-47d2-81ce-e5c6a0dd0a94 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.515393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c6dd0-3710-4413-a497-64faaff618e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.516167 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1319/2618] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:52.516284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c6dd0-3710-4413-a497-64faaff618e9 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.516368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c6dd0-3710-4413-a497-64faaff618e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.516609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c6dd0-3710-4413-a497-64faaff618e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.520039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-432c6dd0-3710-4413-a497-64faaff618e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.520183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2dfca-ffb9-47d2-81ce-e5c6a0dd0a94 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.532622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2dfca-ffb9-47d2-81ce-e5c6a0dd0a94 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.535961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c6dd0-3710-4413-a497-64faaff618e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.538325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.538563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c6dd0-3710-4413-a497-64faaff618e9 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.539384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.539675 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.540012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] PATH_INFO: `/v3/projects/2cacd88ac4e347818b4ba68f9e92b8e3/users/74aa0c9f81064dbfa695826e9267429d/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.542062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cacd88ac4e347818b4ba68f9e92b8e3, user_id=74aa0c9f81064dbfa695826e9267429d, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.545348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.565833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1300/2620] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:52.567693 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1320/2620] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:52 2022] PUT /identity/v3/projects/2cacd88ac4e347818b4ba68f9e92b8e3/users/74aa0c9f81064dbfa695826e9267429d/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:52.569482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b7f15-b1ad-4108-9d84-3bdd4d65fae1 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.570110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b7f15-b1ad-4108-9d84-3bdd4d65fae1 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.570690 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b7f15-b1ad-4108-9d84-3bdd4d65fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.602935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c13b7f15-b1ad-4108-9d84-3bdd4d65fae1 None None] MFA Rules not processed for user `74aa0c9f81064dbfa695826e9267429d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:52.606996 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c13b7f15-b1ad-4108-9d84-3bdd4d65fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.690756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1301/2621] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:52.701681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.703593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.765220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:52.792875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d547-8d85-4f6d-9728-6764f512f921 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.797113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca8c00-fe16-44f1-b48d-3f7701ad9957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.797770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8c00-fe16-44f1-b48d-3f7701ad9957 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.798057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8c00-fe16-44f1-b48d-3f7701ad9957 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.798341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8c00-fe16-44f1-b48d-3f7701ad9957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.809542 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca8c00-fe16-44f1-b48d-3f7701ad9957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.811250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca8c00-fe16-44f1-b48d-3f7701ad9957 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.821897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1321/2622] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:52.873314 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b7f15-b1ad-4108-9d84-3bdd4d65fae1 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.874830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c13b7f15-b1ad-4108-9d84-3bdd4d65fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.887729 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b7f15-b1ad-4108-9d84-3bdd4d65fae1 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.891565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e232440-4aae-4669-888c-c8b85ebdd87c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.892324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232440-4aae-4669-888c-c8b85ebdd87c service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.892669 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232440-4aae-4669-888c-c8b85ebdd87c service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.893050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232440-4aae-4669-888c-c8b85ebdd87c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.956387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e232440-4aae-4669-888c-c8b85ebdd87c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.957844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e232440-4aae-4669-888c-c8b85ebdd87c service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.975277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1302/2623] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:56.743770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca8c00-fe16-44f1-b48d-3f7701ad9957 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:56.829148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca8c00-fe16-44f1-b48d-3f7701ad9957 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:56.835677 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:56.836806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.837245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.837533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] PATH_INFO: `/v3/users/e6ca79632ffd41629cc4e2234a0f1d4a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.838829 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ca79632ffd41629cc4e2234a0f1d4a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:56.840802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:56.902130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ca79632ffd41629cc4e2234a0f1d4a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.919664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ca79632ffd41629cc4e2234a0f1d4a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.929362 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ca79632ffd41629cc4e2234a0f1d4a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.930158 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ca79632ffd41629cc4e2234a0f1d4a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.930880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ca79632ffd41629cc4e2234a0f1d4a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.955572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1322/2624] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:42:56 2022] DELETE /identity/v3/users/e6ca79632ffd41629cc4e2234a0f1d4a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:56.957667 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b2ccf-9cd0-4191-abc1-20e8c5ec09d6 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.958255 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b2ccf-9cd0-4191-abc1-20e8c5ec09d6 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.958740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b2ccf-9cd0-4191-abc1-20e8c5ec09d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.978406 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a17b2ccf-9cd0-4191-abc1-20e8c5ec09d6 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:56.979988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a17b2ccf-9cd0-4191-abc1-20e8c5ec09d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:56.994927 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:57.054537 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1303/2625] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:57.061482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.063724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.185930 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b2ccf-9cd0-4191-abc1-20e8c5ec09d6 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.190360 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a17b2ccf-9cd0-4191-abc1-20e8c5ec09d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.223628 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f3e9-c1fb-41be-83cf-2810dc947bf2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.236311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.237040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.237331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.237610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.248615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.250266 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.262195 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1323/2626] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:57.363165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b2ccf-9cd0-4191-abc1-20e8c5ec09d6 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.381670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.382608 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.383618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.384068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.390530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.438432 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.440715 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.459424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1304/2627] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:57.878440 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.880612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.898961 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c948824-3b70-4700-a6d0-772500d02669 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.904733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.906063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.906520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.906952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] PATH_INFO: `/v3/projects/8bb064dee7324d43b61717519fe14e1b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.908624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb064dee7324d43b61717519fe14e1b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.911046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.913951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:57.983890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb064dee7324d43b61717519fe14e1b', 'request_id': 'req-d3834996-efab-44ae-93f8-b21909f68f4d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.021169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb064dee7324d43b61717519fe14e1b', 'request_id': 'req-d3834996-efab-44ae-93f8-b21909f68f4d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.029760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb064dee7324d43b61717519fe14e1b', 'request_id': 'req-d3834996-efab-44ae-93f8-b21909f68f4d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.046652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] The token cache is being invalidate because project 8bb064dee7324d43b61717519fe14e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:58.047085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.047787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.052345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1324/2628] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:42:57 2022] DELETE /identity/v3/projects/8bb064dee7324d43b61717519fe14e1b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:58.053931 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:58.074181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99cb4f-d147-4898-a2d7-cf00387b3d77 service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:58.157770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:58.158577 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:58.158896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:58.159175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] PATH_INFO: `/v3/users/74aa0c9f81064dbfa695826e9267429d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:58.161813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74aa0c9f81064dbfa695826e9267429d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:58.163928 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:58.238990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74aa0c9f81064dbfa695826e9267429d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.240225 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:58.267596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74aa0c9f81064dbfa695826e9267429d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.269127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74aa0c9f81064dbfa695826e9267429d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.280043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74aa0c9f81064dbfa695826e9267429d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.280756 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74aa0c9f81064dbfa695826e9267429d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.320897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1305/2629] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:42:58 2022] DELETE /identity/v3/users/74aa0c9f81064dbfa695826e9267429d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:58.644040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:58.645193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:58.672093 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:58.673901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:58.761239 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3834996-efab-44ae-93f8-b21909f68f4d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:58.814307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8662515-de16-44d4-a98b-961bf6868f90 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:58.824613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:58.826721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:58.827203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:58.827638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] PATH_INFO: `/v3/projects/2cacd88ac4e347818b4ba68f9e92b8e3` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:58.830538 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cacd88ac4e347818b4ba68f9e92b8e3)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:58.835174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:58.875669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c81a2-cad9-47ca-aa0c-3081160efc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:58.876509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c81a2-cad9-47ca-aa0c-3081160efc45 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:58.876948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c81a2-cad9-47ca-aa0c-3081160efc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:58.877320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c81a2-cad9-47ca-aa0c-3081160efc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:58.884772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9e3c81a2-cad9-47ca-aa0c-3081160efc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:58.898355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c81a2-cad9-47ca-aa0c-3081160efc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:58.900225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c81a2-cad9-47ca-aa0c-3081160efc45 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:58.910161 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1325/2630] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:42:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:58.925997 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cacd88ac4e347818b4ba68f9e92b8e3', 'request_id': 'req-552bd956-ca32-4888-96d1-22a669105898'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.939768 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cacd88ac4e347818b4ba68f9e92b8e3', 'request_id': 'req-552bd956-ca32-4888-96d1-22a669105898'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.947573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cacd88ac4e347818b4ba68f9e92b8e3', 'request_id': 'req-552bd956-ca32-4888-96d1-22a669105898'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.974546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] The token cache is being invalidate because project 2cacd88ac4e347818b4ba68f9e92b8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:58.975311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.976379 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-552bd956-ca32-4888-96d1-22a669105898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:58.980510 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1306/2631] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:42:58 2022] DELETE /identity/v3/projects/2cacd88ac4e347818b4ba68f9e92b8e3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:58.986183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6481bd5-ff2a-4021-b2e0-15d146b41931 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:58.987816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6481bd5-ff2a-4021-b2e0-15d146b41931 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:58.988212 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6481bd5-ff2a-4021-b2e0-15d146b41931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.013112 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d6481bd5-ff2a-4021-b2e0-15d146b41931 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:59.014466 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d6481bd5-ff2a-4021-b2e0-15d146b41931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:59.087187 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:59.113468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1326/2632] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:59.121527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86555-cede-4bd7-ba3e-7f113b7cdd1b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.122486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86555-cede-4bd7-ba3e-7f113b7cdd1b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.122986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86555-cede-4bd7-ba3e-7f113b7cdd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.151677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-6ec86555-cede-4bd7-ba3e-7f113b7cdd1b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:59.153238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-6ec86555-cede-4bd7-ba3e-7f113b7cdd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:59.165884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1307/2633] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:59.170272 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6481bd5-ff2a-4021-b2e0-15d146b41931 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:59.187788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6481bd5-ff2a-4021-b2e0-15d146b41931 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:59.198673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:59.199868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.200461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.201002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.202030 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:59.202741 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:59.204749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:59.221081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1327/2634] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:42:59.225764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec86555-cede-4bd7-ba3e-7f113b7cdd1b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:59.238226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec86555-cede-4bd7-ba3e-7f113b7cdd1b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:59.264963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90104d0d-4042-465f-8e6f-493554ab16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:59.265929 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90104d0d-4042-465f-8e6f-493554ab16b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.266373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90104d0d-4042-465f-8e6f-493554ab16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.266834 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90104d0d-4042-465f-8e6f-493554ab16b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.267851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90104d0d-4042-465f-8e6f-493554ab16b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:59.270725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90104d0d-4042-465f-8e6f-493554ab16b2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:59.319512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1308/2635] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:42:59 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:59.323692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:59.340510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e62f8c-0806-4dd5-b5e0-d00e76d34747 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:59.447884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de1e63-9820-45e9-a73b-9e428059c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:59.448589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de1e63-9820-45e9-a73b-9e428059c2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.448900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de1e63-9820-45e9-a73b-9e428059c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.449183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de1e63-9820-45e9-a73b-9e428059c2ae admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.450188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de1e63-9820-45e9-a73b-9e428059c2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:59.452417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de1e63-9820-45e9-a73b-9e428059c2ae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:59.484108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90104d0d-4042-465f-8e6f-493554ab16b2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:59.491868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1328/2636] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:42:59 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:59.495775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90104d0d-4042-465f-8e6f-493554ab16b2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:59.502567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffe2fe-1074-47dc-aca3-7ebb77594efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:59.504116 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffe2fe-1074-47dc-aca3-7ebb77594efd admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.504418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffe2fe-1074-47dc-aca3-7ebb77594efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.504704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffe2fe-1074-47dc-aca3-7ebb77594efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.506070 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffe2fe-1074-47dc-aca3-7ebb77594efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:59.508614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffe2fe-1074-47dc-aca3-7ebb77594efd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:59.527058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de1e63-9820-45e9-a73b-9e428059c2ae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:59.543503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1309/2637] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:59.547526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de1e63-9820-45e9-a73b-9e428059c2ae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:59.553399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe64a0-38f2-414d-9a0c-62d409299647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:59.554138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe64a0-38f2-414d-9a0c-62d409299647 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.554427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe64a0-38f2-414d-9a0c-62d409299647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.554707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe64a0-38f2-414d-9a0c-62d409299647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.555439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe64a0-38f2-414d-9a0c-62d409299647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:59.557593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe64a0-38f2-414d-9a0c-62d409299647 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:59.573672 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1329/2638] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:59.576091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffe2fe-1074-47dc-aca3-7ebb77594efd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:59.588505 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffe2fe-1074-47dc-aca3-7ebb77594efd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:59.596964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2632a-ba7c-461e-8cd2-b21a66b8970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:59.597868 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2632a-ba7c-461e-8cd2-b21a66b8970b admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.598321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2632a-ba7c-461e-8cd2-b21a66b8970b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.600127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2632a-ba7c-461e-8cd2-b21a66b8970b admin admin] PATH_INFO: `/v3/projects/ee09870e163e4b31bcda200e58fdc987/users/cefd42036c53495a8285b0282a9e5aa0/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.622182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:59.636521 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2632a-ba7c-461e-8cd2-b21a66b8970b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee09870e163e4b31bcda200e58fdc987, user_id=cefd42036c53495a8285b0282a9e5aa0, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:59.639241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2632a-ba7c-461e-8cd2-b21a66b8970b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:59.705477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1310/2639] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:42:59 2022] PUT /identity/v3/projects/ee09870e163e4b31bcda200e58fdc987/users/cefd42036c53495a8285b0282a9e5aa0/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:59.707647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e298e-d2cf-4e34-92e0-5b8efc80d4f1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.708131 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e298e-d2cf-4e34-92e0-5b8efc80d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.709226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e298e-d2cf-4e34-92e0-5b8efc80d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.776262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e34e298e-d2cf-4e34-92e0-5b8efc80d4f1 None None] MFA Rules not processed for user `cefd42036c53495a8285b0282a9e5aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:59.777559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e34e298e-d2cf-4e34-92e0-5b8efc80d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:59.870456 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1330/2640] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:42:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:59.875171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2632a-ba7c-461e-8cd2-b21a66b8970b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:59.965092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2632a-ba7c-461e-8cd2-b21a66b8970b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:59.974861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994810-c288-46bd-bc02-653797dafc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:59.975601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994810-c288-46bd-bc02-653797dafc4f admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:59.976002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994810-c288-46bd-bc02-653797dafc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:59.976346 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994810-c288-46bd-bc02-653797dafc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:59.977297 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1994810-c288-46bd-bc02-653797dafc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:59.979709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1994810-c288-46bd-bc02-653797dafc4f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.014251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1311/2641] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:42:59 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:00.018745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e298e-d2cf-4e34-92e0-5b8efc80d4f1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.043647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e298e-d2cf-4e34-92e0-5b8efc80d4f1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.116651 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:00.139770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b78d7-5acc-4cc3-b5eb-18500852ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.139980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b78d7-5acc-4cc3-b5eb-18500852ce42 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.140250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b78d7-5acc-4cc3-b5eb-18500852ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.140590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b78d7-5acc-4cc3-b5eb-18500852ce42 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.141421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b78d7-5acc-4cc3-b5eb-18500852ce42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.144079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b78d7-5acc-4cc3-b5eb-18500852ce42 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.182694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1331/2642] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:00 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:00.189466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994810-c288-46bd-bc02-653797dafc4f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.211853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994810-c288-46bd-bc02-653797dafc4f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.230544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f3915-2dd2-4b19-ba93-9ba172baf11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.231241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3915-2dd2-4b19-ba93-9ba172baf11f admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.231527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3915-2dd2-4b19-ba93-9ba172baf11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.231809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3915-2dd2-4b19-ba93-9ba172baf11f admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.233180 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f3915-2dd2-4b19-ba93-9ba172baf11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.234622 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f3915-2dd2-4b19-ba93-9ba172baf11f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.260427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1312/2643] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:00.261854 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b78d7-5acc-4cc3-b5eb-18500852ce42 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.277487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b78d7-5acc-4cc3-b5eb-18500852ce42 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.284252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4566e-ad0d-48e3-af82-8c273cb7040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.285091 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4566e-ad0d-48e3-af82-8c273cb7040e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.285475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4566e-ad0d-48e3-af82-8c273cb7040e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.285844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4566e-ad0d-48e3-af82-8c273cb7040e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.287295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4566e-ad0d-48e3-af82-8c273cb7040e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.289145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4566e-ad0d-48e3-af82-8c273cb7040e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.317933 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f3915-2dd2-4b19-ba93-9ba172baf11f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.327734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1332/2644] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:00.330501 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f3915-2dd2-4b19-ba93-9ba172baf11f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.336664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570710c-2af0-4593-b464-4c493b217578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.338758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570710c-2af0-4593-b464-4c493b217578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.338758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570710c-2af0-4593-b464-4c493b217578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.338758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570710c-2af0-4593-b464-4c493b217578 admin admin] PATH_INFO: `/v3/projects/50666feade1447dd9ad2e4b99cd0425a/users/df91628933a843cfb8da2340389f542b/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.366107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570710c-2af0-4593-b464-4c493b217578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50666feade1447dd9ad2e4b99cd0425a, user_id=df91628933a843cfb8da2340389f542b, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.369174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570710c-2af0-4593-b464-4c493b217578 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.402549 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1313/2645] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:00 2022] PUT /identity/v3/projects/50666feade1447dd9ad2e4b99cd0425a/users/df91628933a843cfb8da2340389f542b/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:00.412514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb7b8a-6226-4988-8943-7fea1fd702a4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.412935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb7b8a-6226-4988-8943-7fea1fd702a4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.413317 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb7b8a-6226-4988-8943-7fea1fd702a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.453062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a3bb7b8a-6226-4988-8943-7fea1fd702a4 None None] MFA Rules not processed for user `df91628933a843cfb8da2340389f542b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:00.454524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a3bb7b8a-6226-4988-8943-7fea1fd702a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:00.556750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1333/2646] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:00.561473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570710c-2af0-4593-b464-4c493b217578 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.643108 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570710c-2af0-4593-b464-4c493b217578 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.649536 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d001e-1fe8-4237-abd5-f8d67086a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.650344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d001e-1fe8-4237-abd5-f8d67086a61a admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.650888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d001e-1fe8-4237-abd5-f8d67086a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.651268 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d001e-1fe8-4237-abd5-f8d67086a61a admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.652068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d001e-1fe8-4237-abd5-f8d67086a61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.654496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d001e-1fe8-4237-abd5-f8d67086a61a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.690628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1314/2647] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:43:00 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:00.699036 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb7b8a-6226-4988-8943-7fea1fd702a4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.712574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb7b8a-6226-4988-8943-7fea1fd702a4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.784867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc94acd-7846-4e14-93be-f6a81f2dbe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.785502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc94acd-7846-4e14-93be-f6a81f2dbe7b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.785790 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc94acd-7846-4e14-93be-f6a81f2dbe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.786103 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc94acd-7846-4e14-93be-f6a81f2dbe7b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.786800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc94acd-7846-4e14-93be-f6a81f2dbe7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.788753 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc94acd-7846-4e14-93be-f6a81f2dbe7b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.817951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1334/2648] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:00 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:00.819163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d001e-1fe8-4237-abd5-f8d67086a61a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.836466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d001e-1fe8-4237-abd5-f8d67086a61a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.842778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734a79-427f-47b8-bd31-a6ebb30fba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.843530 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734a79-427f-47b8-bd31-a6ebb30fba3d admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.843754 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734a79-427f-47b8-bd31-a6ebb30fba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.844074 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734a79-427f-47b8-bd31-a6ebb30fba3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.844955 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734a79-427f-47b8-bd31-a6ebb30fba3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.846427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734a79-427f-47b8-bd31-a6ebb30fba3d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.860875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1315/2649] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:43:00.862489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc94acd-7846-4e14-93be-f6a81f2dbe7b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.877668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc94acd-7846-4e14-93be-f6a81f2dbe7b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.882652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dce40-284d-4870-b83e-c07a2f2444df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:00.884188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dce40-284d-4870-b83e-c07a2f2444df admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:00.884470 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dce40-284d-4870-b83e-c07a2f2444df admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:00.884745 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dce40-284d-4870-b83e-c07a2f2444df admin admin] PATH_INFO: `/v3/projects/b0125f82794a428caf4b131f9a8aa37d/users/20d78c0bc4d349abbde8ce4ae108c4b5/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:00.908879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dce40-284d-4870-b83e-c07a2f2444df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0125f82794a428caf4b131f9a8aa37d, user_id=20d78c0bc4d349abbde8ce4ae108c4b5, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:00.911867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dce40-284d-4870-b83e-c07a2f2444df admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:00.931765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1335/2650] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:00 2022] PUT /identity/v3/projects/b0125f82794a428caf4b131f9a8aa37d/users/20d78c0bc4d349abbde8ce4ae108c4b5/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:00.935737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734a79-427f-47b8-bd31-a6ebb30fba3d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:00.948422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734a79-427f-47b8-bd31-a6ebb30fba3d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:00.961424 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:01.015886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285ad6-f159-4c48-b856-dc78ed0371b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:01.016561 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285ad6-f159-4c48-b856-dc78ed0371b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:01.016884 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285ad6-f159-4c48-b856-dc78ed0371b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:01.017166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285ad6-f159-4c48-b856-dc78ed0371b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:01.017893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39285ad6-f159-4c48-b856-dc78ed0371b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:01.019650 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39285ad6-f159-4c48-b856-dc78ed0371b0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:01.031818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1316/2651] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:01.036590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dce40-284d-4870-b83e-c07a2f2444df admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:01.050164 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dce40-284d-4870-b83e-c07a2f2444df admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:01.059084 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:01.060947 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:01.061339 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:01.061703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] PATH_INFO: `/v3/projects/b0125f82794a428caf4b131f9a8aa37d/users/20d78c0bc4d349abbde8ce4ae108c4b5/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:01.064459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0125f82794a428caf4b131f9a8aa37d, user_id=20d78c0bc4d349abbde8ce4ae108c4b5, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:01.067516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:01.082369 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1336/2652] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:01 2022] PUT /identity/v3/projects/b0125f82794a428caf4b131f9a8aa37d/users/20d78c0bc4d349abbde8ce4ae108c4b5/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:01.095047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6edb-c7b6-4292-96ce-4477d5e897c8 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:01.095570 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6edb-c7b6-4292-96ce-4477d5e897c8 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:01.096053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc6edb-c7b6-4292-96ce-4477d5e897c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:01.130535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-44bc6edb-c7b6-4292-96ce-4477d5e897c8 None None] MFA Rules not processed for user `20d78c0bc4d349abbde8ce4ae108c4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:01.131782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-44bc6edb-c7b6-4292-96ce-4477d5e897c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:01.217111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1317/2653] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:01.227395 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:01.229291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:01.238761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:01.307225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6b0e-acad-4c0b-8b45-bc0aef6e085c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:01.311105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:01.311794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:01.312081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:01.312361 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:01.322944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:01.324324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:01.335714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1337/2654] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:01.849062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc6edb-c7b6-4292-96ce-4477d5e897c8 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:01.851572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-44bc6edb-c7b6-4292-96ce-4477d5e897c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:01.926752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc6edb-c7b6-4292-96ce-4477d5e897c8 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:01.936414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:01.937488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:01.939034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:01.939034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:01.942876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:02.010910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:02.033667 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:02.036190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:02.061021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1318/2655] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:02.067960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:02.070557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:02.089638 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735705c3-3941-4f72-80f9-4e41a84dfb2e service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:02.094180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf27c1-922b-44d3-86a5-a619481ece5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:02.094983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf27c1-922b-44d3-86a5-a619481ece5c service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:02.095370 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf27c1-922b-44d3-86a5-a619481ece5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:02.095750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf27c1-922b-44d3-86a5-a619481ece5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:02.180151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf27c1-922b-44d3-86a5-a619481ece5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:02.181810 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf27c1-922b-44d3-86a5-a619481ece5c service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:02.197183 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1338/2656] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:06.321529 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:06.331055 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab6cd1-826d-40c1-95dd-9fbb606057f0 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:06.335533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a55c-afb6-4919-bb33-4de889ffe1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:06.336637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a55c-afb6-4919-bb33-4de889ffe1ed service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:06.336969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a55c-afb6-4919-bb33-4de889ffe1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:06.337248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a55c-afb6-4919-bb33-4de889ffe1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:06.405588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a55c-afb6-4919-bb33-4de889ffe1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:06.407026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a55c-afb6-4919-bb33-4de889ffe1ed service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:06.416737 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1319/2657] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:07.492286 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7578e-baf5-4b7b-96da-d6e3cc9c0eea None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.492800 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7578e-baf5-4b7b-96da-d6e3cc9c0eea None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.492946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7578e-baf5-4b7b-96da-d6e3cc9c0eea None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.494507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1339/2658] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:43:07.501938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94460d-1646-4676-89b3-10e06cf74915 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.501938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94460d-1646-4676-89b3-10e06cf74915 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.502487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94460d-1646-4676-89b3-10e06cf74915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.530728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-ed94460d-1646-4676-89b3-10e06cf74915 None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:07.532367 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ed94460d-1646-4676-89b3-10e06cf74915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:07.638129 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1320/2659] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:43:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:07.645193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7578e-baf5-4b7b-96da-d6e3cc9c0eea None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:07.647054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-16e7578e-baf5-4b7b-96da-d6e3cc9c0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:07.710806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7578e-baf5-4b7b-96da-d6e3cc9c0eea None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:07.714455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90b5e9-1495-466b-b042-c05b569795d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:07.715117 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90b5e9-1495-466b-b042-c05b569795d5 service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:07.715403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90b5e9-1495-466b-b042-c05b569795d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:07.715686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90b5e9-1495-466b-b042-c05b569795d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:07.728377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90b5e9-1495-466b-b042-c05b569795d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:07.729899 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90b5e9-1495-466b-b042-c05b569795d5 service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:07.742612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1340/2660] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:07.999785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94460d-1646-4676-89b3-10e06cf74915 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:08.001212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ed94460d-1646-4676-89b3-10e06cf74915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:08.071188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94460d-1646-4676-89b3-10e06cf74915 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:08.076150 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de8c1-ce6f-46fd-b518-bb549984a3d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:08.077026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de8c1-ce6f-46fd-b518-bb549984a3d2 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:08.077321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de8c1-ce6f-46fd-b518-bb549984a3d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:08.077609 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de8c1-ce6f-46fd-b518-bb549984a3d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:08.079433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a85de8c1-ce6f-46fd-b518-bb549984a3d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:08.092191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85de8c1-ce6f-46fd-b518-bb549984a3d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:08.093809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85de8c1-ce6f-46fd-b518-bb549984a3d2 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:08.103957 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1321/2661] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:08.886538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90b5e9-1495-466b-b042-c05b569795d5 service glance] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:08.905681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90b5e9-1495-466b-b042-c05b569795d5 service glance] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:08.919011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75be811-670d-4458-824a-a178193a086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:08.919902 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75be811-670d-4458-824a-a178193a086a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:08.920379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75be811-670d-4458-824a-a178193a086a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:08.920669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75be811-670d-4458-824a-a178193a086a admin admin] PATH_INFO: `/v3/users/cefd42036c53495a8285b0282a9e5aa0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:08.921950 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75be811-670d-4458-824a-a178193a086a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefd42036c53495a8285b0282a9e5aa0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:08.924302 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75be811-670d-4458-824a-a178193a086a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:09.014206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:09.017784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a75be811-670d-4458-824a-a178193a086a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefd42036c53495a8285b0282a9e5aa0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.039426 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a75be811-670d-4458-824a-a178193a086a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefd42036c53495a8285b0282a9e5aa0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.052491 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a75be811-670d-4458-824a-a178193a086a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefd42036c53495a8285b0282a9e5aa0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.053501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a75be811-670d-4458-824a-a178193a086a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefd42036c53495a8285b0282a9e5aa0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.054199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a75be811-670d-4458-824a-a178193a086a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefd42036c53495a8285b0282a9e5aa0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.080502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1341/2662] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:08 2022] DELETE /identity/v3/users/cefd42036c53495a8285b0282a9e5aa0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:09.082366 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7f01-3d8f-4113-b6df-144d43ce33b5 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:09.083789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7f01-3d8f-4113-b6df-144d43ce33b5 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:09.084090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7f01-3d8f-4113-b6df-144d43ce33b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:09.099690 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:09.108559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-51ad7f01-3d8f-4113-b6df-144d43ce33b5 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:09.109833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-51ad7f01-3d8f-4113-b6df-144d43ce33b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:09.127269 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75be811-670d-4458-824a-a178193a086a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:09.128795 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a75be811-670d-4458-824a-a178193a086a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:09.194028 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1322/2663] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:09.199997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75be811-670d-4458-824a-a178193a086a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:09.205083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:09.205679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7f01-3d8f-4113-b6df-144d43ce33b5 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:09.205971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:09.206262 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:09.206548 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] PATH_INFO: `/v3/users/b8e78886edbc4ee8aaf4efc77e0316f8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:09.207512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-51ad7f01-3d8f-4113-b6df-144d43ce33b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:09.208323 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e78886edbc4ee8aaf4efc77e0316f8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:09.210311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:09.268625 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e78886edbc4ee8aaf4efc77e0316f8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.273956 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7f01-3d8f-4113-b6df-144d43ce33b5 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:09.277819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8319a0e-c1d3-4535-89a4-6caa9fbd42f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:09.278573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319a0e-c1d3-4535-89a4-6caa9fbd42f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:09.278861 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319a0e-c1d3-4535-89a4-6caa9fbd42f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:09.279187 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319a0e-c1d3-4535-89a4-6caa9fbd42f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:09.287250 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e78886edbc4ee8aaf4efc77e0316f8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.293706 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8319a0e-c1d3-4535-89a4-6caa9fbd42f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:09.295813 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8319a0e-c1d3-4535-89a4-6caa9fbd42f7 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:09.299006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e78886edbc4ee8aaf4efc77e0316f8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.300078 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e78886edbc4ee8aaf4efc77e0316f8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.301087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e78886edbc4ee8aaf4efc77e0316f8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.307111 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1323/2664] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:43:09.326597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1342/2665] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:09 2022] DELETE /identity/v3/users/b8e78886edbc4ee8aaf4efc77e0316f8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:09.505302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8319a0e-c1d3-4535-89a4-6caa9fbd42f7 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:09.521923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8319a0e-c1d3-4535-89a4-6caa9fbd42f7 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:09.590328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:09.591765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:09.603102 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:09.604228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:09.604623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:09.605013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] PATH_INFO: `/v3/projects/1e633e4c115040a39a0604c812e1475b` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:09.606769 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e633e4c115040a39a0604c812e1475b)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:09.608887 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:09.647647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:09.669196 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e633e4c115040a39a0604c812e1475b', 'request_id': 'req-b149bd11-84bd-4800-9aa2-a55ede472159'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.671623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:09.674832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770a2ea-691b-489c-b751-8e0540d82bbe admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:09.677442 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e633e4c115040a39a0604c812e1475b', 'request_id': 'req-b149bd11-84bd-4800-9aa2-a55ede472159'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.688974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e633e4c115040a39a0604c812e1475b', 'request_id': 'req-b149bd11-84bd-4800-9aa2-a55ede472159'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.703628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] The token cache is being invalidate because project 1e633e4c115040a39a0604c812e1475b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:09.704041 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.704674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.706494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1324/2666] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:09 2022] DELETE /identity/v3/projects/1e633e4c115040a39a0604c812e1475b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:09.710771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:09.711662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:09.744244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:09.745175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:09.745443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:09.745723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] PATH_INFO: `/v3/projects/ee09870e163e4b31bcda200e58fdc987` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:09.747062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee09870e163e4b31bcda200e58fdc987)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:09.749177 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:09.788641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149bd11-84bd-4800-9aa2-a55ede472159 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:09.804968 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee09870e163e4b31bcda200e58fdc987', 'request_id': 'req-f6678cc8-c011-4ea5-80df-c822e93a1746'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.810817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee09870e163e4b31bcda200e58fdc987', 'request_id': 'req-f6678cc8-c011-4ea5-80df-c822e93a1746'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.818390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee09870e163e4b31bcda200e58fdc987', 'request_id': 'req-f6678cc8-c011-4ea5-80df-c822e93a1746'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.834035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] The token cache is being invalidate because project ee09870e163e4b31bcda200e58fdc987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:09.834464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.834979 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.839376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1343/2667] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:09 2022] DELETE /identity/v3/projects/ee09870e163e4b31bcda200e58fdc987 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:09.840603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:09.842609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:09.853572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:09.854451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:09.854857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:09.855141 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] PATH_INFO: `/v3/users/f933db5569464bbcb6bbf0bb62359d33` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:09.856396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f933db5569464bbcb6bbf0bb62359d33)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:09.858476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:09.907267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f933db5569464bbcb6bbf0bb62359d33'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.919029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6678cc8-c011-4ea5-80df-c822e93a1746 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:09.924029 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:09.924979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f933db5569464bbcb6bbf0bb62359d33'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.925109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:09.925384 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:09.925664 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] PATH_INFO: `/v3/users/df91628933a843cfb8da2340389f542b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:09.926850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f933db5569464bbcb6bbf0bb62359d33'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.927682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df91628933a843cfb8da2340389f542b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:09.929662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:09.937483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f933db5569464bbcb6bbf0bb62359d33'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.938356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f933db5569464bbcb6bbf0bb62359d33'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:09.953516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:09.955427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1325/2668] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:09 2022] DELETE /identity/v3/users/f933db5569464bbcb6bbf0bb62359d33 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:10.002802 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df91628933a843cfb8da2340389f542b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.022188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df91628933a843cfb8da2340389f542b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.030796 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df91628933a843cfb8da2340389f542b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.031533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df91628933a843cfb8da2340389f542b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.032652 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df91628933a843cfb8da2340389f542b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.051019 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1344/2669] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:09 2022] DELETE /identity/v3/users/df91628933a843cfb8da2340389f542b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:10.147590 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:10.149443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.160030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:10.233046 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dd4ea-9670-46a2-bf2f-43196acd448b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:10.303612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:10.304822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.304822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.305256 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] PATH_INFO: `/v3/projects/cffb926fbfe74a82ad1ad4aa79762452` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.306642 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffb926fbfe74a82ad1ad4aa79762452)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:10.308585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:10.357462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffb926fbfe74a82ad1ad4aa79762452', 'request_id': 'req-b225c611-cd65-4f5c-8126-1b680c09ac46'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.363119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffb926fbfe74a82ad1ad4aa79762452', 'request_id': 'req-b225c611-cd65-4f5c-8126-1b680c09ac46'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.369550 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffb926fbfe74a82ad1ad4aa79762452', 'request_id': 'req-b225c611-cd65-4f5c-8126-1b680c09ac46'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.383858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] The token cache is being invalidate because project cffb926fbfe74a82ad1ad4aa79762452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:10.384060 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.384936 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b225c611-cd65-4f5c-8126-1b680c09ac46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.386770 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1326/2670] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:10 2022] DELETE /identity/v3/projects/cffb926fbfe74a82ad1ad4aa79762452 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:10.563611 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:10.565215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.583951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338a85-ce00-454d-8ee0-33ac6921c8b6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:10.630313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc186ae4-98c4-480e-8916-b167023b7324 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.630584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc186ae4-98c4-480e-8916-b167023b7324 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.630881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc186ae4-98c4-480e-8916-b167023b7324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.650875 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-fc186ae4-98c4-480e-8916-b167023b7324 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:10.652126 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fc186ae4-98c4-480e-8916-b167023b7324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.670569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:10.671427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.671709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.671982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] PATH_INFO: `/v3/projects/50666feade1447dd9ad2e4b99cd0425a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.673480 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50666feade1447dd9ad2e4b99cd0425a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:10.675432 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:10.694641 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:10.712229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1327/2671] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:43:10.725127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50666feade1447dd9ad2e4b99cd0425a', 'request_id': 'req-41829b8d-d88a-4f33-aee3-c6914cad7403'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.725944 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc186ae4-98c4-480e-8916-b167023b7324 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:10.727288 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-fc186ae4-98c4-480e-8916-b167023b7324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.730709 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50666feade1447dd9ad2e4b99cd0425a', 'request_id': 'req-41829b8d-d88a-4f33-aee3-c6914cad7403'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.736900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50666feade1447dd9ad2e4b99cd0425a', 'request_id': 'req-41829b8d-d88a-4f33-aee3-c6914cad7403'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.749453 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] The token cache is being invalidate because project 50666feade1447dd9ad2e4b99cd0425a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:10.749744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.750356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.751879 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1345/2672] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:10 2022] DELETE /identity/v3/projects/50666feade1447dd9ad2e4b99cd0425a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:10.756080 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:10.757431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.788146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:10.799476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc186ae4-98c4-480e-8916-b167023b7324 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:10.826243 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41829b8d-d88a-4f33-aee3-c6914cad7403 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:10.830801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:10.831667 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.831952 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.832227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] PATH_INFO: `/v3/users/20d78c0bc4d349abbde8ce4ae108c4b5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.833997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d78c0bc4d349abbde8ce4ae108c4b5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:10.835914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:10.862723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718a70e-6e32-4dde-ac39-40d4a11cd386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:10.863826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a70e-6e32-4dde-ac39-40d4a11cd386 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.863826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a70e-6e32-4dde-ac39-40d4a11cd386 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.864049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a70e-6e32-4dde-ac39-40d4a11cd386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.866121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8718a70e-6e32-4dde-ac39-40d4a11cd386 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.880850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d78c0bc4d349abbde8ce4ae108c4b5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.892444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d78c0bc4d349abbde8ce4ae108c4b5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.900692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d78c0bc4d349abbde8ce4ae108c4b5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.901418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d78c0bc4d349abbde8ce4ae108c4b5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.902047 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d78c0bc4d349abbde8ce4ae108c4b5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.914511 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1346/2673] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:10 2022] DELETE /identity/v3/users/20d78c0bc4d349abbde8ce4ae108c4b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:10.926029 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718a70e-6e32-4dde-ac39-40d4a11cd386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:10.927659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718a70e-6e32-4dde-ac39-40d4a11cd386 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:10.936025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1328/2674] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:43:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:43:11.570890 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:11.572538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:11.652942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc73d1-8fd0-4234-8e86-176aeda9cb83 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:11.657699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:11.658707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:11.659013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:11.659265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] PATH_INFO: `/v3/projects/b0125f82794a428caf4b131f9a8aa37d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:11.661248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0125f82794a428caf4b131f9a8aa37d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:11.666462 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:11.725128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:11.726331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0125f82794a428caf4b131f9a8aa37d', 'request_id': 'req-2ea47468-aafe-4fbd-a6e4-29c835449e4f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.737463 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0125f82794a428caf4b131f9a8aa37d', 'request_id': 'req-2ea47468-aafe-4fbd-a6e4-29c835449e4f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.745997 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0125f82794a428caf4b131f9a8aa37d', 'request_id': 'req-2ea47468-aafe-4fbd-a6e4-29c835449e4f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.760714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] The token cache is being invalidate because project b0125f82794a428caf4b131f9a8aa37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:11.761012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.761824 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ea47468-aafe-4fbd-a6e4-29c835449e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.763547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1347/2675] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:11 2022] DELETE /identity/v3/projects/b0125f82794a428caf4b131f9a8aa37d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:11.769405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236c36e-223c-4e64-9418-f9a686bdc0e7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:11.769915 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236c36e-223c-4e64-9418-f9a686bdc0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:11.770109 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236c36e-223c-4e64-9418-f9a686bdc0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:11.790999 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-a236c36e-223c-4e64-9418-f9a686bdc0e7 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:11.792234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-a236c36e-223c-4e64-9418-f9a686bdc0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:11.823901 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=100 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:11.862106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1329/2676] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:11.870756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b796692-0cb7-4b26-8f62-df595416fd51 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:11.871067 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b796692-0cb7-4b26-8f62-df595416fd51 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:11.871334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b796692-0cb7-4b26-8f62-df595416fd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:11.891893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4b796692-0cb7-4b26-8f62-df595416fd51 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:11.893356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b796692-0cb7-4b26-8f62-df595416fd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:11.905700 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1348/2677] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:11.908878 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236c36e-223c-4e64-9418-f9a686bdc0e7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:11.918847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236c36e-223c-4e64-9418-f9a686bdc0e7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:11.923600 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:11.924260 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:11.924540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:11.924864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:11.925580 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:43:11.925883 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:11.928006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:11.939292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1330/2678] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:43:11.944316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b796692-0cb7-4b26-8f62-df595416fd51 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:11.955469 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b796692-0cb7-4b26-8f62-df595416fd51 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:11.961379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a15d65-6b52-42ce-b423-b16721585ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:11.962048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a15d65-6b52-42ce-b423-b16721585ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:11.962330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a15d65-6b52-42ce-b423-b16721585ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:11.962607 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a15d65-6b52-42ce-b423-b16721585ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:11.963316 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a15d65-6b52-42ce-b423-b16721585ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:11.965343 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a15d65-6b52-42ce-b423-b16721585ca7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:11.993734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1349/2679] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:43:11 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:11.998010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.008879 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06429f-0e46-485d-8f31-d4df5bab2762 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.069474 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c146a8e-0c69-4e8b-b69e-ad30b43b8a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.070175 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c146a8e-0c69-4e8b-b69e-ad30b43b8a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.070499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c146a8e-0c69-4e8b-b69e-ad30b43b8a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.070744 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c146a8e-0c69-4e8b-b69e-ad30b43b8a23 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.071479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c146a8e-0c69-4e8b-b69e-ad30b43b8a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.073429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c146a8e-0c69-4e8b-b69e-ad30b43b8a23 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.097926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1331/2680] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:11 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:12.099359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a15d65-6b52-42ce-b423-b16721585ca7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.110839 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a15d65-6b52-42ce-b423-b16721585ca7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.117555 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe1b78-95c1-4744-ad02-2edd9c9349f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.118510 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1b78-95c1-4744-ad02-2edd9c9349f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.119017 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1b78-95c1-4744-ad02-2edd9c9349f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.119399 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1b78-95c1-4744-ad02-2edd9c9349f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.120398 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe1b78-95c1-4744-ad02-2edd9c9349f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.122509 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe1b78-95c1-4744-ad02-2edd9c9349f9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.135719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1350/2681] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:12.139794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c146a8e-0c69-4e8b-b69e-ad30b43b8a23 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.150138 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c146a8e-0c69-4e8b-b69e-ad30b43b8a23 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.155299 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c5130-3c0f-4176-ac72-23b2c69b06a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.155967 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c5130-3c0f-4176-ac72-23b2c69b06a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.156247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c5130-3c0f-4176-ac72-23b2c69b06a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.156522 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c5130-3c0f-4176-ac72-23b2c69b06a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.157281 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c5130-3c0f-4176-ac72-23b2c69b06a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.158893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c5130-3c0f-4176-ac72-23b2c69b06a2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.173771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1332/2682] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:12.175330 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe1b78-95c1-4744-ad02-2edd9c9349f9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.188378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe1b78-95c1-4744-ad02-2edd9c9349f9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.194980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467c49-cb7a-4a6f-98c1-fdf07286ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.195953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467c49-cb7a-4a6f-98c1-fdf07286ae73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.196290 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467c49-cb7a-4a6f-98c1-fdf07286ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.196565 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467c49-cb7a-4a6f-98c1-fdf07286ae73 admin admin] PATH_INFO: `/v3/projects/f7933358a6b04dfc83da2a25373c4b39/users/d3c3942f486a4954b740cd2ecc0e5f4d/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.212586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42467c49-cb7a-4a6f-98c1-fdf07286ae73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7933358a6b04dfc83da2a25373c4b39, user_id=d3c3942f486a4954b740cd2ecc0e5f4d, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.215314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42467c49-cb7a-4a6f-98c1-fdf07286ae73 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.228900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1351/2683] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:12 2022] PUT /identity/v3/projects/f7933358a6b04dfc83da2a25373c4b39/users/d3c3942f486a4954b740cd2ecc0e5f4d/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:12.241385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b259bd-e966-4728-83d9-7d881b7c1e3c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.241682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b259bd-e966-4728-83d9-7d881b7c1e3c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.241969 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b259bd-e966-4728-83d9-7d881b7c1e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.272143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-03b259bd-e966-4728-83d9-7d881b7c1e3c None None] MFA Rules not processed for user `d3c3942f486a4954b740cd2ecc0e5f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:12.273566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-03b259bd-e966-4728-83d9-7d881b7c1e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:12.343184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1333/2684] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:12.347982 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467c49-cb7a-4a6f-98c1-fdf07286ae73 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.414460 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467c49-cb7a-4a6f-98c1-fdf07286ae73 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.419430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef91fc-ca4b-4d6f-83e7-050435b93f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.420094 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef91fc-ca4b-4d6f-83e7-050435b93f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.420380 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef91fc-ca4b-4d6f-83e7-050435b93f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.420674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef91fc-ca4b-4d6f-83e7-050435b93f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.421528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef91fc-ca4b-4d6f-83e7-050435b93f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.423633 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef91fc-ca4b-4d6f-83e7-050435b93f78 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.457082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1352/2685] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:43:12 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:12.458047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b259bd-e966-4728-83d9-7d881b7c1e3c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.469704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b259bd-e966-4728-83d9-7d881b7c1e3c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.499775 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:12.534939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d5c2-4f44-47ac-9b32-b173eda149e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.536172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d5c2-4f44-47ac-9b32-b173eda149e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.536462 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d5c2-4f44-47ac-9b32-b173eda149e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.536926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d5c2-4f44-47ac-9b32-b173eda149e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.537771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689d5c2-4f44-47ac-9b32-b173eda149e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.539719 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689d5c2-4f44-47ac-9b32-b173eda149e5 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.580131 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1334/2686] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:12 2022] POST /identity/v3/users => generated 302 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:12.583877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef91fc-ca4b-4d6f-83e7-050435b93f78 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.604096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef91fc-ca4b-4d6f-83e7-050435b93f78 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.609528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be40f8-f237-4c39-88ba-4d1cc33c3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.610518 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be40f8-f237-4c39-88ba-4d1cc33c3c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.610818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be40f8-f237-4c39-88ba-4d1cc33c3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.611141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be40f8-f237-4c39-88ba-4d1cc33c3c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.611838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be40f8-f237-4c39-88ba-4d1cc33c3c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.613558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be40f8-f237-4c39-88ba-4d1cc33c3c31 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.629596 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1353/2687] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:12.633464 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d5c2-4f44-47ac-9b32-b173eda149e5 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.644489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d5c2-4f44-47ac-9b32-b173eda149e5 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.650399 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c4b67-fe55-4c45-82e4-8a3694ab4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.651470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c4b67-fe55-4c45-82e4-8a3694ab4a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.651762 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c4b67-fe55-4c45-82e4-8a3694ab4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.652081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c4b67-fe55-4c45-82e4-8a3694ab4a9a admin admin] PATH_INFO: `/v3/projects/5c7eff2c307f4176bbb0fb8aa7958775/users/e3554899b7dc44e1ae82dec28c74c3c7/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.671362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c4b67-fe55-4c45-82e4-8a3694ab4a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7eff2c307f4176bbb0fb8aa7958775, user_id=e3554899b7dc44e1ae82dec28c74c3c7, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.674275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c4b67-fe55-4c45-82e4-8a3694ab4a9a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.704020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1335/2688] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:12 2022] PUT /identity/v3/projects/5c7eff2c307f4176bbb0fb8aa7958775/users/e3554899b7dc44e1ae82dec28c74c3c7/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:12.708388 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be40f8-f237-4c39-88ba-4d1cc33c3c31 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.720738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be40f8-f237-4c39-88ba-4d1cc33c3c31 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.778685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:12.799944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd862291-869c-4ee6-a80f-0f41897cd0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.801149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862291-869c-4ee6-a80f-0f41897cd0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.801471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862291-869c-4ee6-a80f-0f41897cd0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.801913 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd862291-869c-4ee6-a80f-0f41897cd0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.802674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd862291-869c-4ee6-a80f-0f41897cd0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.804293 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd862291-869c-4ee6-a80f-0f41897cd0a7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.816109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1354/2689] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:43:12.820409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c4b67-fe55-4c45-82e4-8a3694ab4a9a admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.830945 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c4b67-fe55-4c45-82e4-8a3694ab4a9a admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:12.836123 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:12.837061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.837343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.837655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] PATH_INFO: `/v3/projects/5c7eff2c307f4176bbb0fb8aa7958775/users/e3554899b7dc44e1ae82dec28c74c3c7/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.839760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7eff2c307f4176bbb0fb8aa7958775, user_id=e3554899b7dc44e1ae82dec28c74c3c7, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:12.843448 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:12.855799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1336/2690] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:12 2022] PUT /identity/v3/projects/5c7eff2c307f4176bbb0fb8aa7958775/users/e3554899b7dc44e1ae82dec28c74c3c7/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:12.870736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56b71-5955-452b-abf7-73f2aeb41b5b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:12.871121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56b71-5955-452b-abf7-73f2aeb41b5b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:12.871546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56b71-5955-452b-abf7-73f2aeb41b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:12.900472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b4f56b71-5955-452b-abf7-73f2aeb41b5b None None] MFA Rules not processed for user `e3554899b7dc44e1ae82dec28c74c3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:12.901933 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b4f56b71-5955-452b-abf7-73f2aeb41b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:12.980261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1355/2691] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:12.988311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:12.990247 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:13.052193 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb10a-6a72-4617-817b-252e61adc9c3 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:13.056485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da58f89-bd4c-4a8b-b2d1-1a779121631f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:13.057182 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58f89-bd4c-4a8b-b2d1-1a779121631f service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:13.057466 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58f89-bd4c-4a8b-b2d1-1a779121631f service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:13.057745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58f89-bd4c-4a8b-b2d1-1a779121631f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:13.068004 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da58f89-bd4c-4a8b-b2d1-1a779121631f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:13.069485 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da58f89-bd4c-4a8b-b2d1-1a779121631f service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:13.078840 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1337/2692] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:13.131079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f56b71-5955-452b-abf7-73f2aeb41b5b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:13.132589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b4f56b71-5955-452b-abf7-73f2aeb41b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:13.144577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f56b71-5955-452b-abf7-73f2aeb41b5b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:13.148756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93c88-fa5a-4b7a-9703-242bde356259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:13.149431 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93c88-fa5a-4b7a-9703-242bde356259 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:13.149714 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93c88-fa5a-4b7a-9703-242bde356259 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:13.149991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93c88-fa5a-4b7a-9703-242bde356259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:13.215928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc93c88-fa5a-4b7a-9703-242bde356259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:13.217777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc93c88-fa5a-4b7a-9703-242bde356259 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:13.227654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1356/2693] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:16.696488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da58f89-bd4c-4a8b-b2d1-1a779121631f service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:16.764155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da58f89-bd4c-4a8b-b2d1-1a779121631f service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:16.768757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:16.769603 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:16.769916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:16.770189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] PATH_INFO: `/v3/users/d3c3942f486a4954b740cd2ecc0e5f4d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:16.771397 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c3942f486a4954b740cd2ecc0e5f4d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:16.773351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:16.805174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:16.831986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c3942f486a4954b740cd2ecc0e5f4d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:16.849134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c3942f486a4954b740cd2ecc0e5f4d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:16.850044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c3942f486a4954b740cd2ecc0e5f4d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:16.861331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c3942f486a4954b740cd2ecc0e5f4d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:16.861990 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c3942f486a4954b740cd2ecc0e5f4d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:16.875679 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1338/2694] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:16 2022] DELETE /identity/v3/users/d3c3942f486a4954b740cd2ecc0e5f4d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:16.880389 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a61c3-e56a-42ee-b8f4-1536b1623d44 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:16.881557 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a61c3-e56a-42ee-b8f4-1536b1623d44 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:16.882108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a61c3-e56a-42ee-b8f4-1536b1623d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:16.903236 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b02a61c3-e56a-42ee-b8f4-1536b1623d44 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:16.904433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b02a61c3-e56a-42ee-b8f4-1536b1623d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:16.969227 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1357/2695] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:43:16.979502 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:16.980938 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:17.043497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e990f6-382c-44c4-bcfc-7a7e99aa6037 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:17.047201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b939f-5286-441a-8aaa-503b2e7770df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:17.047860 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b939f-5286-441a-8aaa-503b2e7770df service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:17.048145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b939f-5286-441a-8aaa-503b2e7770df service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:17.048425 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b939f-5286-441a-8aaa-503b2e7770df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:17.058857 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b939f-5286-441a-8aaa-503b2e7770df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:17.060381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b939f-5286-441a-8aaa-503b2e7770df service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:17.078497 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1339/2696] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:17.385958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a61c3-e56a-42ee-b8f4-1536b1623d44 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:17.387472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b02a61c3-e56a-42ee-b8f4-1536b1623d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:17.402595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a61c3-e56a-42ee-b8f4-1536b1623d44 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:17.407255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:17.408137 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:17.408415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:17.408697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] PATH_INFO: `/v3/projects/f7933358a6b04dfc83da2a25373c4b39` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:17.409992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7933358a6b04dfc83da2a25373c4b39)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:17.412524 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:17.414481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:17.506742 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7933358a6b04dfc83da2a25373c4b39', 'request_id': 'req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.513662 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7933358a6b04dfc83da2a25373c4b39', 'request_id': 'req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.522045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7933358a6b04dfc83da2a25373c4b39', 'request_id': 'req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.540106 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] The token cache is being invalidate because project f7933358a6b04dfc83da2a25373c4b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:17.540494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.541299 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.554749 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b939f-5286-441a-8aaa-503b2e7770df service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:17.559500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1358/2697] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:17 2022] DELETE /identity/v3/projects/f7933358a6b04dfc83da2a25373c4b39 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:17.564705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b939f-5286-441a-8aaa-503b2e7770df service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:17.633341 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:17.634591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:17.635085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:17.635573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] PATH_INFO: `/v3/users/e3554899b7dc44e1ae82dec28c74c3c7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:17.637224 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3554899b7dc44e1ae82dec28c74c3c7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:17.639427 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:17.689935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3554899b7dc44e1ae82dec28c74c3c7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.691451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:17.708329 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3554899b7dc44e1ae82dec28c74c3c7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.709163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3554899b7dc44e1ae82dec28c74c3c7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.722514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3554899b7dc44e1ae82dec28c74c3c7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.723687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-871c7ebd-dcf7-494e-b7c1-5620ce1980c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3554899b7dc44e1ae82dec28c74c3c7'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:17.738086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1340/2698] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:17 2022] DELETE /identity/v3/users/e3554899b7dc44e1ae82dec28c74c3c7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:18.072223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.073906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:18.094082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca71d-c1ef-46d7-b8b7-3d4771812d2c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:18.164712 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:18.165635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.165916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.166194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] PATH_INFO: `/v3/projects/5c7eff2c307f4176bbb0fb8aa7958775` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.167416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7eff2c307f4176bbb0fb8aa7958775)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:18.169517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:18.219623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7eff2c307f4176bbb0fb8aa7958775', 'request_id': 'req-80a33490-4785-44a2-aec4-c2e0b9238f36'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:18.236533 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7eff2c307f4176bbb0fb8aa7958775', 'request_id': 'req-80a33490-4785-44a2-aec4-c2e0b9238f36'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:18.243991 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7eff2c307f4176bbb0fb8aa7958775', 'request_id': 'req-80a33490-4785-44a2-aec4-c2e0b9238f36'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:18.263713 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] The token cache is being invalidate because project 5c7eff2c307f4176bbb0fb8aa7958775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:18.264012 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:18.264846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-80a33490-4785-44a2-aec4-c2e0b9238f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:18.266678 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1359/2699] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:18 2022] DELETE /identity/v3/projects/5c7eff2c307f4176bbb0fb8aa7958775 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:18.272885 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5722-af38-4466-907d-1f9a00c6f3de None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.273179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5722-af38-4466-907d-1f9a00c6f3de None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.273457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5722-af38-4466-907d-1f9a00c6f3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.291828 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-19bf5722-af38-4466-907d-1f9a00c6f3de None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:18.293215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-19bf5722-af38-4466-907d-1f9a00c6f3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:18.362443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1341/2700] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:43:18.370320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b3f6-4aed-48f7-92ea-546d08fd3ff8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.370730 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b3f6-4aed-48f7-92ea-546d08fd3ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.370936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b3f6-4aed-48f7-92ea-546d08fd3ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.391648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e402b3f6-4aed-48f7-92ea-546d08fd3ff8 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:18.392948 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e402b3f6-4aed-48f7-92ea-546d08fd3ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:18.402219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1360/2701] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:18.406621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5722-af38-4466-907d-1f9a00c6f3de None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.417599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5722-af38-4466-907d-1f9a00c6f3de None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:18.422704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:18.423375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.423658 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.423932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.424662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:43:18.425027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:18.426825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:18.439787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1342/2702] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:43:18.444761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402b3f6-4aed-48f7-92ea-546d08fd3ff8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.455180 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402b3f6-4aed-48f7-92ea-546d08fd3ff8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:18.460955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabaf42-07a1-4df5-a1a5-88700f853140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:18.461619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabaf42-07a1-4df5-a1a5-88700f853140 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.461921 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabaf42-07a1-4df5-a1a5-88700f853140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.462197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabaf42-07a1-4df5-a1a5-88700f853140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.462884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabaf42-07a1-4df5-a1a5-88700f853140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:18.464803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabaf42-07a1-4df5-a1a5-88700f853140 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:18.475506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:18.498805 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1361/2703] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:43:18 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:43:18.500121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.511240 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b5df-e670-4907-b526-5f542f704b65 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:18.571236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e17fba-946a-4ca5-aa63-f804d324c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:18.572020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17fba-946a-4ca5-aa63-f804d324c438 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.572389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17fba-946a-4ca5-aa63-f804d324c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.572736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17fba-946a-4ca5-aa63-f804d324c438 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.573528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e17fba-946a-4ca5-aa63-f804d324c438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:18.575565 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e17fba-946a-4ca5-aa63-f804d324c438 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:18.597937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1343/2704] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:18 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:18.602332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabaf42-07a1-4df5-a1a5-88700f853140 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.614575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabaf42-07a1-4df5-a1a5-88700f853140 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:18.620820 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982148-ac23-4122-8308-c33ee818942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:18.622674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982148-ac23-4122-8308-c33ee818942e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.622674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982148-ac23-4122-8308-c33ee818942e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.623265 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982148-ac23-4122-8308-c33ee818942e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.624326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f982148-ac23-4122-8308-c33ee818942e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:18.626621 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f982148-ac23-4122-8308-c33ee818942e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:18.640725 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1362/2705] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:43:18.644295 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e17fba-946a-4ca5-aa63-f804d324c438 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.660526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e17fba-946a-4ca5-aa63-f804d324c438 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:18.674503 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972e37e-f9aa-4aa3-bfd8-2fad506be8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:18.675163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e37e-f9aa-4aa3-bfd8-2fad506be8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.675444 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e37e-f9aa-4aa3-bfd8-2fad506be8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.675757 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972e37e-f9aa-4aa3-bfd8-2fad506be8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.677183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972e37e-f9aa-4aa3-bfd8-2fad506be8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:18.678903 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972e37e-f9aa-4aa3-bfd8-2fad506be8f9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:18.696871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1344/2706] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:18.706909 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982148-ac23-4122-8308-c33ee818942e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.719872 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982148-ac23-4122-8308-c33ee818942e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:18.733657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fa57b-ae25-487c-850b-672e04d7f197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:18.737530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fa57b-ae25-487c-850b-672e04d7f197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.737833 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fa57b-ae25-487c-850b-672e04d7f197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.739284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fa57b-ae25-487c-850b-672e04d7f197 admin admin] PATH_INFO: `/v3/projects/dbc8165e17834769b25058685f82cf65/users/0f91aaa76eae4c9ba90ca9b1832fff20/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.773371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fa57b-ae25-487c-850b-672e04d7f197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc8165e17834769b25058685f82cf65, user_id=0f91aaa76eae4c9ba90ca9b1832fff20, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:18.776171 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fa57b-ae25-487c-850b-672e04d7f197 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:18.800658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1363/2707] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:18 2022] PUT /identity/v3/projects/dbc8165e17834769b25058685f82cf65/users/0f91aaa76eae4c9ba90ca9b1832fff20/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:18.811377 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de45d7-c821-4f32-b782-b51c60102c6b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.811963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de45d7-c821-4f32-b782-b51c60102c6b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.811963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de45d7-c821-4f32-b782-b51c60102c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.841118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-13de45d7-c821-4f32-b782-b51c60102c6b None None] MFA Rules not processed for user `0f91aaa76eae4c9ba90ca9b1832fff20`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:18.842586 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-13de45d7-c821-4f32-b782-b51c60102c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:18.866526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:18.923073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1345/2708] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:18.928191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fa57b-ae25-487c-850b-672e04d7f197 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.996801 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fa57b-ae25-487c-850b-672e04d7f197 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.001823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f36d9-fc7e-4e1d-a0b1-fe3645b8f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.002494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f36d9-fc7e-4e1d-a0b1-fe3645b8f759 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.002773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f36d9-fc7e-4e1d-a0b1-fe3645b8f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.003054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f36d9-fc7e-4e1d-a0b1-fe3645b8f759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.003756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f36d9-fc7e-4e1d-a0b1-fe3645b8f759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.007134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f36d9-fc7e-4e1d-a0b1-fe3645b8f759 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.036911 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1364/2709] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:43:18 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:43:19.041021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de45d7-c821-4f32-b782-b51c60102c6b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.052205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de45d7-c821-4f32-b782-b51c60102c6b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.111157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7cb02-a94b-4cfb-8fc0-76d26a519e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.111844 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7cb02-a94b-4cfb-8fc0-76d26a519e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.112132 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7cb02-a94b-4cfb-8fc0-76d26a519e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.112415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7cb02-a94b-4cfb-8fc0-76d26a519e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.113149 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7cb02-a94b-4cfb-8fc0-76d26a519e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.115728 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7cb02-a94b-4cfb-8fc0-76d26a519e1c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.139581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1346/2710] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:19.144001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f36d9-fc7e-4e1d-a0b1-fe3645b8f759 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.154774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f36d9-fc7e-4e1d-a0b1-fe3645b8f759 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.160880 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a755-06b1-424a-83b6-b1a80bdddd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.161728 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a755-06b1-424a-83b6-b1a80bdddd52 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.162104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a755-06b1-424a-83b6-b1a80bdddd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.162417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a755-06b1-424a-83b6-b1a80bdddd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.163220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a755-06b1-424a-83b6-b1a80bdddd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.164944 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a755-06b1-424a-83b6-b1a80bdddd52 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.176659 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1365/2711] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:43:19.180527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7cb02-a94b-4cfb-8fc0-76d26a519e1c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.190613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7cb02-a94b-4cfb-8fc0-76d26a519e1c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.195872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9108e-88b6-4556-9c5e-6627cc9aa678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.196534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9108e-88b6-4556-9c5e-6627cc9aa678 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.196822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9108e-88b6-4556-9c5e-6627cc9aa678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.197137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9108e-88b6-4556-9c5e-6627cc9aa678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.197872 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9108e-88b6-4556-9c5e-6627cc9aa678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.199508 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9108e-88b6-4556-9c5e-6627cc9aa678 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.213438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1347/2712] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:19.214563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a755-06b1-424a-83b6-b1a80bdddd52 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.225701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a755-06b1-424a-83b6-b1a80bdddd52 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.230336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483e212-cc38-48ce-8214-b2bccff4d1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.231213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e212-cc38-48ce-8214-b2bccff4d1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.231495 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e212-cc38-48ce-8214-b2bccff4d1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.231803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e212-cc38-48ce-8214-b2bccff4d1a6 admin admin] PATH_INFO: `/v3/projects/fec36e56f53247469e777bd9f6311d0f/users/da3ac0b0660f4d02b95f99cad65bb497/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.246747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483e212-cc38-48ce-8214-b2bccff4d1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec36e56f53247469e777bd9f6311d0f, user_id=da3ac0b0660f4d02b95f99cad65bb497, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.249455 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483e212-cc38-48ce-8214-b2bccff4d1a6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.267951 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1366/2713] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:19 2022] PUT /identity/v3/projects/fec36e56f53247469e777bd9f6311d0f/users/da3ac0b0660f4d02b95f99cad65bb497/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:19.336058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3308b-7518-4980-88a7-abf64e6e0f5c None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.336373 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3308b-7518-4980-88a7-abf64e6e0f5c None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.336664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3308b-7518-4980-88a7-abf64e6e0f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.363362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bbd3308b-7518-4980-88a7-abf64e6e0f5c None None] MFA Rules not processed for user `da3ac0b0660f4d02b95f99cad65bb497`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:19.365443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bbd3308b-7518-4980-88a7-abf64e6e0f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:19.427514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1348/2714] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:19.431848 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483e212-cc38-48ce-8214-b2bccff4d1a6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.492210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483e212-cc38-48ce-8214-b2bccff4d1a6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.496929 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed082-6001-431f-a862-a136dcf60036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.497612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed082-6001-431f-a862-a136dcf60036 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.497904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed082-6001-431f-a862-a136dcf60036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.498184 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed082-6001-431f-a862-a136dcf60036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.498871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed082-6001-431f-a862-a136dcf60036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.500778 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed082-6001-431f-a862-a136dcf60036 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.510304 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:19.528966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1367/2715] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:19.531463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3308b-7518-4980-88a7-abf64e6e0f5c None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.542876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3308b-7518-4980-88a7-abf64e6e0f5c None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.568345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:19.600959 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946423b-5d60-46e1-9a07-d6094715307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.601630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946423b-5d60-46e1-9a07-d6094715307e admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.601916 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946423b-5d60-46e1-9a07-d6094715307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.602222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946423b-5d60-46e1-9a07-d6094715307e admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.602942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946423b-5d60-46e1-9a07-d6094715307e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.604886 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946423b-5d60-46e1-9a07-d6094715307e admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.624334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1349/2716] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:43:19.628376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed082-6001-431f-a862-a136dcf60036 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.638671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed082-6001-431f-a862-a136dcf60036 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.643270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308fdd2-e4b2-4fb0-8bb9-320996c66305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.643927 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308fdd2-e4b2-4fb0-8bb9-320996c66305 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.644213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308fdd2-e4b2-4fb0-8bb9-320996c66305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.644494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308fdd2-e4b2-4fb0-8bb9-320996c66305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.645762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308fdd2-e4b2-4fb0-8bb9-320996c66305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.647367 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308fdd2-e4b2-4fb0-8bb9-320996c66305 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.657671 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1368/2717] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:19.662302 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946423b-5d60-46e1-9a07-d6094715307e admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.672073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946423b-5d60-46e1-9a07-d6094715307e admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.676677 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de8025-bd8d-4247-b6f9-7a59cee4c486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.677640 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de8025-bd8d-4247-b6f9-7a59cee4c486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.677876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de8025-bd8d-4247-b6f9-7a59cee4c486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.678152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de8025-bd8d-4247-b6f9-7a59cee4c486 admin admin] PATH_INFO: `/v3/projects/756f16038e5d468fbed13e4517ea1fb3/users/a1b91f8b4cce40b4a54217942ee257b2/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.693694 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de8025-bd8d-4247-b6f9-7a59cee4c486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756f16038e5d468fbed13e4517ea1fb3, user_id=a1b91f8b4cce40b4a54217942ee257b2, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.696544 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de8025-bd8d-4247-b6f9-7a59cee4c486 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.709457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1350/2718] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:19 2022] PUT /identity/v3/projects/756f16038e5d468fbed13e4517ea1fb3/users/a1b91f8b4cce40b4a54217942ee257b2/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:19.713271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308fdd2-e4b2-4fb0-8bb9-320996c66305 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.723885 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308fdd2-e4b2-4fb0-8bb9-320996c66305 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.780942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f0028-e9f5-4c21-8e7f-99685d704f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.781635 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f0028-e9f5-4c21-8e7f-99685d704f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.781914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f0028-e9f5-4c21-8e7f-99685d704f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.782188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f0028-e9f5-4c21-8e7f-99685d704f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.782901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f0028-e9f5-4c21-8e7f-99685d704f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.784489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f0028-e9f5-4c21-8e7f-99685d704f0b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.798249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1369/2719] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:19.799334 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de8025-bd8d-4247-b6f9-7a59cee4c486 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.809648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de8025-bd8d-4247-b6f9-7a59cee4c486 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.814279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.815160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.815438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.815708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] PATH_INFO: `/v3/projects/756f16038e5d468fbed13e4517ea1fb3/users/a1b91f8b4cce40b4a54217942ee257b2/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.818581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756f16038e5d468fbed13e4517ea1fb3, user_id=a1b91f8b4cce40b4a54217942ee257b2, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.821215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.831455 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1351/2720] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:19 2022] PUT /identity/v3/projects/756f16038e5d468fbed13e4517ea1fb3/users/a1b91f8b4cce40b4a54217942ee257b2/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:19.842657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c093609-3158-424e-9d12-ef605b709e61 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.843014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c093609-3158-424e-9d12-ef605b709e61 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.843359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c093609-3158-424e-9d12-ef605b709e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.869575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2c093609-3158-424e-9d12-ef605b709e61 None None] MFA Rules not processed for user `a1b91f8b4cce40b4a54217942ee257b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:19.870822 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2c093609-3158-424e-9d12-ef605b709e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:19.939755 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1370/2721] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:19.951616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.953392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:20.010475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bc75d-0b21-4cdb-b051-681c0dff04b8 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:20.014120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbe37a-fc5f-4a58-9cbd-52bb5091bfc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:20.014764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbe37a-fc5f-4a58-9cbd-52bb5091bfc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:20.015049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbe37a-fc5f-4a58-9cbd-52bb5091bfc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:20.015331 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbe37a-fc5f-4a58-9cbd-52bb5091bfc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:20.069781 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbe37a-fc5f-4a58-9cbd-52bb5091bfc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:20.071210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbe37a-fc5f-4a58-9cbd-52bb5091bfc2 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:20.080035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1352/2722] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:21.549278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c093609-3158-424e-9d12-ef605b709e61 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:21.550682 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2c093609-3158-424e-9d12-ef605b709e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:21.563041 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c093609-3158-424e-9d12-ef605b709e61 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:21.566553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7eeb24-4477-442b-a5e1-29ccd8686bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:21.567190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eeb24-4477-442b-a5e1-29ccd8686bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:21.567476 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eeb24-4477-442b-a5e1-29ccd8686bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:21.567757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eeb24-4477-442b-a5e1-29ccd8686bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:21.623934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7eeb24-4477-442b-a5e1-29ccd8686bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:21.625423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7eeb24-4477-442b-a5e1-29ccd8686bb1 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:21.629928 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:21.634986 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1371/2723] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:22.145042 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbe37a-fc5f-4a58-9cbd-52bb5091bfc2 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:22.154030 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbe37a-fc5f-4a58-9cbd-52bb5091bfc2 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:22.158311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db51377-77d1-471c-85d7-231077e2d980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:22.159120 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db51377-77d1-471c-85d7-231077e2d980 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:22.159252 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db51377-77d1-471c-85d7-231077e2d980 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:22.159532 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db51377-77d1-471c-85d7-231077e2d980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:22.171062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db51377-77d1-471c-85d7-231077e2d980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:22.172519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db51377-77d1-471c-85d7-231077e2d980 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:22.184121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1353/2724] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:25.978301 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a025-4a4a-4bc5-b99e-6214e88ab044 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:25.978756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a025-4a4a-4bc5-b99e-6214e88ab044 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:25.978851 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a025-4a4a-4bc5-b99e-6214e88ab044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:26.001378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8e06a025-4a4a-4bc5-b99e-6214e88ab044 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:26.003090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8e06a025-4a4a-4bc5-b99e-6214e88ab044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:26.059173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db51377-77d1-471c-85d7-231077e2d980 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:26.062531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1372/2725] 10.222.0.79 () {58 vars in 967 bytes} [Fri May 27 09:43:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:26.075887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06a025-4a4a-4bc5-b99e-6214e88ab044 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:26.077334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8e06a025-4a4a-4bc5-b99e-6214e88ab044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:26.089678 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:26.137058 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db51377-77d1-471c-85d7-231077e2d980 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:26.142829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:26.143837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:26.144190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:26.144535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] PATH_INFO: `/v3/users/0f91aaa76eae4c9ba90ca9b1832fff20` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:26.146591 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f91aaa76eae4c9ba90ca9b1832fff20)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:26.148533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:26.162479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06a025-4a4a-4bc5-b99e-6214e88ab044 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:26.167748 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc61fb-50c2-4854-940f-443e35165c73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:26.168403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc61fb-50c2-4854-940f-443e35165c73 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:26.168688 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc61fb-50c2-4854-940f-443e35165c73 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:26.169002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc61fb-50c2-4854-940f-443e35165c73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:26.178179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc61fb-50c2-4854-940f-443e35165c73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:26.180421 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc61fb-50c2-4854-940f-443e35165c73 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:26.190054 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1373/2726] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:43:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:43:26.202209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f91aaa76eae4c9ba90ca9b1832fff20'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.214683 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f91aaa76eae4c9ba90ca9b1832fff20'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.215409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f91aaa76eae4c9ba90ca9b1832fff20'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.224323 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f91aaa76eae4c9ba90ca9b1832fff20'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.225271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f91aaa76eae4c9ba90ca9b1832fff20'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.238563 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1354/2727] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:26 2022] DELETE /identity/v3/users/0f91aaa76eae4c9ba90ca9b1832fff20 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:26.243004 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43161d3-d6d4-48e6-ad29-8c7e27a2182d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:26.243359 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43161d3-d6d4-48e6-ad29-8c7e27a2182d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:26.243731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43161d3-d6d4-48e6-ad29-8c7e27a2182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:26.263699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f43161d3-d6d4-48e6-ad29-8c7e27a2182d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:26.265063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f43161d3-d6d4-48e6-ad29-8c7e27a2182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:26.329906 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1374/2728] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:26.341061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:26.342731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:26.406140 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b0e38-72bb-457a-8bd8-098e71b31d25 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:26.410496 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd5897-5842-45d8-8660-390545cb3846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:26.411854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5897-5842-45d8-8660-390545cb3846 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:26.412144 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5897-5842-45d8-8660-390545cb3846 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:26.412488 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5897-5842-45d8-8660-390545cb3846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:26.422388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd5897-5842-45d8-8660-390545cb3846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:26.423918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd5897-5842-45d8-8660-390545cb3846 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:26.434623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1355/2729] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:26.710644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43161d3-d6d4-48e6-ad29-8c7e27a2182d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:26.712284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f43161d3-d6d4-48e6-ad29-8c7e27a2182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:26.735992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43161d3-d6d4-48e6-ad29-8c7e27a2182d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:26.742766 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:26.743706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:26.744108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:26.744589 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] PATH_INFO: `/v3/projects/dbc8165e17834769b25058685f82cf65` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:26.746385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc8165e17834769b25058685f82cf65)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:26.748718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:26.786252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:26.800082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc8165e17834769b25058685f82cf65', 'request_id': 'req-bf00aa18-3137-4411-9e8f-828cd41de461'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.805718 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc8165e17834769b25058685f82cf65', 'request_id': 'req-bf00aa18-3137-4411-9e8f-828cd41de461'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.811876 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc8165e17834769b25058685f82cf65', 'request_id': 'req-bf00aa18-3137-4411-9e8f-828cd41de461'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.825089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] The token cache is being invalidate because project dbc8165e17834769b25058685f82cf65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:26.825377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.825996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.827561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1375/2730] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:26 2022] DELETE /identity/v3/projects/dbc8165e17834769b25058685f82cf65 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:26.831519 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd5897-5842-45d8-8660-390545cb3846 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:26.841635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd5897-5842-45d8-8660-390545cb3846 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:26.882091 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:26.898882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:26.899758 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:26.900045 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:26.900330 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] PATH_INFO: `/v3/users/da3ac0b0660f4d02b95f99cad65bb497` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:26.901515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3ac0b0660f4d02b95f99cad65bb497)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:26.903439 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:26.948078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3ac0b0660f4d02b95f99cad65bb497'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.959662 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3ac0b0660f4d02b95f99cad65bb497'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.960321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3ac0b0660f4d02b95f99cad65bb497'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.967724 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3ac0b0660f4d02b95f99cad65bb497'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.968487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3ac0b0660f4d02b95f99cad65bb497'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:26.980436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1356/2731] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:26 2022] DELETE /identity/v3/users/da3ac0b0660f4d02b95f99cad65bb497 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:27.258946 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:27.260616 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:27.275762 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00aa18-3137-4411-9e8f-828cd41de461 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:27.338063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:27.339065 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:27.339351 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:27.339684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] PATH_INFO: `/v3/projects/fec36e56f53247469e777bd9f6311d0f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:27.341031 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec36e56f53247469e777bd9f6311d0f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:27.343953 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:27.390819 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec36e56f53247469e777bd9f6311d0f', 'request_id': 'req-67337c4c-b8c3-4d65-8629-e267e72576f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.396220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec36e56f53247469e777bd9f6311d0f', 'request_id': 'req-67337c4c-b8c3-4d65-8629-e267e72576f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.402319 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec36e56f53247469e777bd9f6311d0f', 'request_id': 'req-67337c4c-b8c3-4d65-8629-e267e72576f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.415109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] The token cache is being invalidate because project fec36e56f53247469e777bd9f6311d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:27.415400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.416015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.417575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1376/2732] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:27 2022] DELETE /identity/v3/projects/fec36e56f53247469e777bd9f6311d0f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:27.421512 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:27.422888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:27.436494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c94a-ae0c-48ab-8ec7-d0fa0e07bcdd admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:27.491197 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:27.492061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:27.492348 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:27.492623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] PATH_INFO: `/v3/users/a1b91f8b4cce40b4a54217942ee257b2` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:27.493825 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b91f8b4cce40b4a54217942ee257b2)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:27.495745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:27.539470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b91f8b4cce40b4a54217942ee257b2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.550974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b91f8b4cce40b4a54217942ee257b2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.552201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b91f8b4cce40b4a54217942ee257b2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.553855 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:27.559837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b91f8b4cce40b4a54217942ee257b2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.560865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f09e9399-2d91-490d-be2c-4422aed1511d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b91f8b4cce40b4a54217942ee257b2'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.573351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1357/2733] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:43:27 2022] DELETE /identity/v3/users/a1b91f8b4cce40b4a54217942ee257b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:27.842577 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:27.844026 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:27.860226 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337c4c-b8c3-4d65-8629-e267e72576f6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:27.905473 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:27.919915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:27.920891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:27.921182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:27.921465 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] PATH_INFO: `/v3/projects/756f16038e5d468fbed13e4517ea1fb3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:27.922650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=756f16038e5d468fbed13e4517ea1fb3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:27.924574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:27.969248 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756f16038e5d468fbed13e4517ea1fb3', 'request_id': 'req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.975499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756f16038e5d468fbed13e4517ea1fb3', 'request_id': 'req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.981479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756f16038e5d468fbed13e4517ea1fb3', 'request_id': 'req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.993312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] The token cache is being invalidate because project 756f16038e5d468fbed13e4517ea1fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:27.993598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.994211 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f747ce39-7a7c-4382-bfc9-c3c775a85f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:27.995771 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1377/2734] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:43:27 2022] DELETE /identity/v3/projects/756f16038e5d468fbed13e4517ea1fb3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:28.001170 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2489a4-953c-4787-ae5d-4f18e763fd49 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.001467 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2489a4-953c-4787-ae5d-4f18e763fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.001752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2489a4-953c-4787-ae5d-4f18e763fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.020210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-4a2489a4-953c-4787-ae5d-4f18e763fd49 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:28.022355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4a2489a4-953c-4787-ae5d-4f18e763fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:28.078688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1358/2735] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:28.087993 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf93d-5537-4eb6-a674-5b168e0e2351 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.088285 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf93d-5537-4eb6-a674-5b168e0e2351 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.088569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf93d-5537-4eb6-a674-5b168e0e2351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.106956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-891bf93d-5537-4eb6-a674-5b168e0e2351 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:28.108096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-891bf93d-5537-4eb6-a674-5b168e0e2351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:28.115990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1378/2736] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:28.120100 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2489a4-953c-4787-ae5d-4f18e763fd49 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:28.130134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2489a4-953c-4787-ae5d-4f18e763fd49 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:28.134692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:28.135343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.135630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.135909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.136635 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:43:28.136976 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:28.138573 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:28.150463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1359/2737] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:43:28.154606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf93d-5537-4eb6-a674-5b168e0e2351 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:28.163694 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf93d-5537-4eb6-a674-5b168e0e2351 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:28.168372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafa7f-6b10-4562-87ec-598785d4cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:28.169043 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafa7f-6b10-4562-87ec-598785d4cca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.169332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafa7f-6b10-4562-87ec-598785d4cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.169612 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafa7f-6b10-4562-87ec-598785d4cca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.170300 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fafa7f-6b10-4562-87ec-598785d4cca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:28.172225 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fafa7f-6b10-4562-87ec-598785d4cca2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:28.199390 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1379/2738] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:43:28 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:28.203628 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:28.214211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378d8aa-3bb0-4a76-b063-cffbe7b83e24 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:28.271267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef43f-8f78-42c6-be1f-662c595160ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:28.271932 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef43f-8f78-42c6-be1f-662c595160ab admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.272216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef43f-8f78-42c6-be1f-662c595160ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.272499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef43f-8f78-42c6-be1f-662c595160ab admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.273219 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfef43f-8f78-42c6-be1f-662c595160ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:28.275127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfef43f-8f78-42c6-be1f-662c595160ab admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:28.294410 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1360/2739] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:28 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:43:28.299095 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafa7f-6b10-4562-87ec-598785d4cca2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:28.312648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafa7f-6b10-4562-87ec-598785d4cca2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:28.317868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1b1b-f32e-4bff-8677-71bd4d9d2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:28.318527 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1b1b-f32e-4bff-8677-71bd4d9d2600 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.318814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1b1b-f32e-4bff-8677-71bd4d9d2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.319096 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1b1b-f32e-4bff-8677-71bd4d9d2600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.319813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a1b1b-f32e-4bff-8677-71bd4d9d2600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:28.321450 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a1b1b-f32e-4bff-8677-71bd4d9d2600 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:28.331757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1380/2740] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:28.336473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef43f-8f78-42c6-be1f-662c595160ab admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:28.346862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef43f-8f78-42c6-be1f-662c595160ab admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:28.351495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452be915-4e9e-4b4a-9257-98b27651188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:28.352169 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452be915-4e9e-4b4a-9257-98b27651188b admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.352453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452be915-4e9e-4b4a-9257-98b27651188b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.352760 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452be915-4e9e-4b4a-9257-98b27651188b admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.353515 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452be915-4e9e-4b4a-9257-98b27651188b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:28.355105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452be915-4e9e-4b4a-9257-98b27651188b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:28.364984 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1361/2741] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:28.368855 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1b1b-f32e-4bff-8677-71bd4d9d2600 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:28.378750 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1b1b-f32e-4bff-8677-71bd4d9d2600 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:28.383895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:28.384765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.385205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.385472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] PATH_INFO: `/v3/projects/131620a4522846dbb6d681995a075da5/users/7f67d7eb2f8540ae80dbcb7aedf2ba8a/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.400530 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131620a4522846dbb6d681995a075da5, user_id=7f67d7eb2f8540ae80dbcb7aedf2ba8a, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:28.403223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:28.415996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1381/2742] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:28 2022] PUT /identity/v3/projects/131620a4522846dbb6d681995a075da5/users/7f67d7eb2f8540ae80dbcb7aedf2ba8a/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:43:28.421181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d879a-981d-42b2-bff4-b2111b39c7d3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.421473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d879a-981d-42b2-bff4-b2111b39c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.421755 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d879a-981d-42b2-bff4-b2111b39c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.439559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5d3d879a-981d-42b2-bff4-b2111b39c7d3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:28.440751 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5d3d879a-981d-42b2-bff4-b2111b39c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:28.485039 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:28.502044 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1362/2743] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:28.511684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:28.513558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:28.569942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fbf2c-0111-4878-aa94-c9e42bbf2e73 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:28.573609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a6053-0912-448f-9b00-5e92ac7fdb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:28.574254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a6053-0912-448f-9b00-5e92ac7fdb77 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:28.574541 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a6053-0912-448f-9b00-5e92ac7fdb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:28.574821 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a6053-0912-448f-9b00-5e92ac7fdb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:28.584159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a6053-0912-448f-9b00-5e92ac7fdb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:28.585622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a6053-0912-448f-9b00-5e92ac7fdb77 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:28.595143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1382/2744] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:32.182215 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d428f-5004-4509-8191-fdc358b77a37 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:32.182710 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d428f-5004-4509-8191-fdc358b77a37 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:32.182974 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d428f-5004-4509-8191-fdc358b77a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:32.213428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-7f9d428f-5004-4509-8191-fdc358b77a37 None None] MFA Rules not processed for user `7f67d7eb2f8540ae80dbcb7aedf2ba8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:32.214616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7f9d428f-5004-4509-8191-fdc358b77a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:32.282151 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1363/2745] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:32.286615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a6053-0912-448f-9b00-5e92ac7fdb77 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:32.296576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a6053-0912-448f-9b00-5e92ac7fdb77 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:32.302147 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25039-8cc5-432b-9e90-7ab2f01ecdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:32.302813 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25039-8cc5-432b-9e90-7ab2f01ecdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:32.303098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25039-8cc5-432b-9e90-7ab2f01ecdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:32.303377 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25039-8cc5-432b-9e90-7ab2f01ecdb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:32.304074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef25039-8cc5-432b-9e90-7ab2f01ecdb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:32.306021 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef25039-8cc5-432b-9e90-7ab2f01ecdb1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:32.320642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:32.334871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1383/2746] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:43:32 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:32.338772 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d428f-5004-4509-8191-fdc358b77a37 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:32.349958 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d428f-5004-4509-8191-fdc358b77a37 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:32.407458 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266c52-ecff-4ab7-8543-dfe14b0ddf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:32.408032 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c52-ecff-4ab7-8543-dfe14b0ddf14 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:32.408315 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c52-ecff-4ab7-8543-dfe14b0ddf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:32.408593 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c52-ecff-4ab7-8543-dfe14b0ddf14 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:32.409322 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca266c52-ecff-4ab7-8543-dfe14b0ddf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:32.411393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca266c52-ecff-4ab7-8543-dfe14b0ddf14 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:32.433941 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1364/2747] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:43:32 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:43:32.438860 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25039-8cc5-432b-9e90-7ab2f01ecdb1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:32.456125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25039-8cc5-432b-9e90-7ab2f01ecdb1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:32.460985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de3a68-e305-45a6-9c65-0b4af42f57aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:32.461670 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3a68-e305-45a6-9c65-0b4af42f57aa admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:32.461958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3a68-e305-45a6-9c65-0b4af42f57aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:32.462242 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3a68-e305-45a6-9c65-0b4af42f57aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:32.462977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de3a68-e305-45a6-9c65-0b4af42f57aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:32.466634 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de3a68-e305-45a6-9c65-0b4af42f57aa admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:32.479033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1384/2748] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:32.483160 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266c52-ecff-4ab7-8543-dfe14b0ddf14 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:32.493829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266c52-ecff-4ab7-8543-dfe14b0ddf14 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:32.498554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b4e8-c10c-481d-8374-1c7f46bbe941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:32.499450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b4e8-c10c-481d-8374-1c7f46bbe941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:32.499734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b4e8-c10c-481d-8374-1c7f46bbe941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:32.500012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b4e8-c10c-481d-8374-1c7f46bbe941 admin admin] PATH_INFO: `/v3/projects/76ca6cffe48946c0bab5af96d50659b0/users/e13c2cc89bd94d338d27aabc3ca3eb0d/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:32.516511 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308b4e8-c10c-481d-8374-1c7f46bbe941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca6cffe48946c0bab5af96d50659b0, user_id=e13c2cc89bd94d338d27aabc3ca3eb0d, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:32.519230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308b4e8-c10c-481d-8374-1c7f46bbe941 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:32.532914 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1365/2749] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:32 2022] PUT /identity/v3/projects/76ca6cffe48946c0bab5af96d50659b0/users/e13c2cc89bd94d338d27aabc3ca3eb0d/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:32.537355 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de3a68-e305-45a6-9c65-0b4af42f57aa admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:32.547862 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de3a68-e305-45a6-9c65-0b4af42f57aa admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:32.605604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23922b2f-00d1-469f-9b6f-ea4879c60b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:32.606379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922b2f-00d1-469f-9b6f-ea4879c60b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:32.606669 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922b2f-00d1-469f-9b6f-ea4879c60b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:32.606958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922b2f-00d1-469f-9b6f-ea4879c60b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:32.607723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23922b2f-00d1-469f-9b6f-ea4879c60b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:32.609378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23922b2f-00d1-469f-9b6f-ea4879c60b7c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:32.623759 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1385/2750] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:43:32.626688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b4e8-c10c-481d-8374-1c7f46bbe941 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:32.639750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b4e8-c10c-481d-8374-1c7f46bbe941 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:32.645601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:32.646870 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:32.647238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:32.647585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] PATH_INFO: `/v3/projects/76ca6cffe48946c0bab5af96d50659b0/users/e13c2cc89bd94d338d27aabc3ca3eb0d/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:32.650198 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca6cffe48946c0bab5af96d50659b0, user_id=e13c2cc89bd94d338d27aabc3ca3eb0d, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:32.654576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:32.666441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1366/2751] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:43:32 2022] PUT /identity/v3/projects/76ca6cffe48946c0bab5af96d50659b0/users/e13c2cc89bd94d338d27aabc3ca3eb0d/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:36.942751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a3c6-9c9b-46ea-9d7d-ac84a9edf72e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:36.943332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a3c6-9c9b-46ea-9d7d-ac84a9edf72e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:36.943332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a3c6-9c9b-46ea-9d7d-ac84a9edf72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:36.989958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2b96a3c6-9c9b-46ea-9d7d-ac84a9edf72e None None] MFA Rules not processed for user `e13c2cc89bd94d338d27aabc3ca3eb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:36.991197 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2b96a3c6-9c9b-46ea-9d7d-ac84a9edf72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:37.081291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1386/2752] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:37.103611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:37.104942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:37.150533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:37.178977 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e66e42-6fcc-4ab3-8a9d-4513a003f75d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:37.183040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:37.183673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:37.184236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:37.184531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:37.253205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:37.255423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:37.265601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1367/2753] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:37.381145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644018-d75e-4cbf-a970-48ac72793141 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:37.381441 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644018-d75e-4cbf-a970-48ac72793141 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:37.381733 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644018-d75e-4cbf-a970-48ac72793141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:37.402646 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-22644018-d75e-4cbf-a970-48ac72793141 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:37.403868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-22644018-d75e-4cbf-a970-48ac72793141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:37.470314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1387/2754] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:37.483192 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:37.484723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:37.570934 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84340c-4a85-4560-a4c4-7e01232fd106 service glance] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:37.576012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:37.576667 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:37.577090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:37.577264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:37.585778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:37.587392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:37.597567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1368/2755] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:43:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:43:46.610429 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912a19-303e-4728-b715-913c8a9a6780 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:46.611009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912a19-303e-4728-b715-913c8a9a6780 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:46.611009 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912a19-303e-4728-b715-913c8a9a6780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:46.628936 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2b912a19-303e-4728-b715-913c8a9a6780 None None] MFA Rules not processed for user `7f67d7eb2f8540ae80dbcb7aedf2ba8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:46.630622 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2b912a19-303e-4728-b715-913c8a9a6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:46.637403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1388/2756] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:43:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:46.889486 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:46.890937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:46.949697 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14658a78-92f0-4938-8bfb-f214bccc8298 service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:46.953403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:46.954050 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:46.954336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:46.954614 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:46.956380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:46.965700 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:46.967389 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:46.975835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1369/2757] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:43:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:48.485060 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aef90-0d9b-49d1-a75d-a1cfdbb773dd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:48.485546 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aef90-0d9b-49d1-a75d-a1cfdbb773dd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:48.485666 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aef90-0d9b-49d1-a75d-a1cfdbb773dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:48.493806 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:48.504102 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b32aef90-0d9b-49d1-a75d-a1cfdbb773dd None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:48.505341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b32aef90-0d9b-49d1-a75d-a1cfdbb773dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:48.512457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1389/2758] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:43:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:48.525006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:48.537908 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955067f-7b95-4a78-acb3-aae69af1701d service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:48.543008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6abc-06f1-4d28-9408-44d26844e97b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:48.543720 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6abc-06f1-4d28-9408-44d26844e97b service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:48.544165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6abc-06f1-4d28-9408-44d26844e97b service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:48.544447 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6abc-06f1-4d28-9408-44d26844e97b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:48.553368 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad6abc-06f1-4d28-9408-44d26844e97b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:48.554987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad6abc-06f1-4d28-9408-44d26844e97b service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:48.563125 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1370/2759] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:43:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:43:58.500526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:58.559809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=98 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:08.748077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb40e0-f4f8-416e-a8b6-5cf0e4491b8e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:08.748590 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb40e0-f4f8-416e-a8b6-5cf0e4491b8e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:08.748690 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb40e0-f4f8-416e-a8b6-5cf0e4491b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:08.766551 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-74cb40e0-f4f8-416e-a8b6-5cf0e4491b8e None None] MFA Rules not processed for user `72ba7e1e48df4d319dd472f33da41f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:08.767738 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-74cb40e0-f4f8-416e-a8b6-5cf0e4491b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:08.827007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1390/2760] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:44:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:09.153598 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6abc-06f1-4d28-9408-44d26844e97b service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:09.163808 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6abc-06f1-4d28-9408-44d26844e97b service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:09.167865 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15785-e446-408e-98ef-36115acd144b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:09.168654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15785-e446-408e-98ef-36115acd144b service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:09.168965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15785-e446-408e-98ef-36115acd144b service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:09.169423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15785-e446-408e-98ef-36115acd144b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:09.181964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c15785-e446-408e-98ef-36115acd144b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:09.183403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c15785-e446-408e-98ef-36115acd144b service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:09.193388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1371/2761] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:44:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:11.085113 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb40e0-f4f8-416e-a8b6-5cf0e4491b8e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:11.086569 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-74cb40e0-f4f8-416e-a8b6-5cf0e4491b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:11.188573 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb40e0-f4f8-416e-a8b6-5cf0e4491b8e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:11.195613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:11.196274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:11.196565 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:11.196942 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:11.199295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:11.216515 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:11.218517 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:11.232373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1391/2762] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:44:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:19.188732 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:21.226501 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=59 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:16.814748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c13058-44c4-4d67-8782-ab0a38e6845f None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.815352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c13058-44c4-4d67-8782-ab0a38e6845f None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.815352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c13058-44c4-4d67-8782-ab0a38e6845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.832546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-31c13058-44c4-4d67-8782-ab0a38e6845f None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:16.833847 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-31c13058-44c4-4d67-8782-ab0a38e6845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:16.841166 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1372/2763] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:45:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:16.882657 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:16.894015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09f0d9-56ea-4e9a-a7c5-913cdf3c9aa9 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:16.899104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfeb70-5958-45f2-a411-4bdaf669d9a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:16.899761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfeb70-5958-45f2-a411-4bdaf669d9a0 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:16.900049 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfeb70-5958-45f2-a411-4bdaf669d9a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:16.900859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfeb70-5958-45f2-a411-4bdaf669d9a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:16.910723 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfeb70-5958-45f2-a411-4bdaf669d9a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:16.912405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfeb70-5958-45f2-a411-4bdaf669d9a0 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:16.923104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1392/2764] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:45:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:45:26.828047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:26.918904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:29.224564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c13058-44c4-4d67-8782-ab0a38e6845f None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:29.226000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-31c13058-44c4-4d67-8782-ab0a38e6845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:29.297654 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c13058-44c4-4d67-8782-ab0a38e6845f None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:29.307277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837509e-3d40-49c6-8ec8-a3e5c87f5954 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:29.307925 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837509e-3d40-49c6-8ec8-a3e5c87f5954 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:29.308209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837509e-3d40-49c6-8ec8-a3e5c87f5954 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:29.308490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837509e-3d40-49c6-8ec8-a3e5c87f5954 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:29.310318 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-0837509e-3d40-49c6-8ec8-a3e5c87f5954 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:29.322981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837509e-3d40-49c6-8ec8-a3e5c87f5954 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:29.326086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837509e-3d40-49c6-8ec8-a3e5c87f5954 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:29.335291 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1373/2765] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:45:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:30.632411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfeb70-5958-45f2-a411-4bdaf669d9a0 service swift] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:30.641959 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfeb70-5958-45f2-a411-4bdaf669d9a0 service swift] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:30.645644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6580ca-a51d-4f86-8dc6-eb0fa7fae40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:30.646278 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6580ca-a51d-4f86-8dc6-eb0fa7fae40c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:30.646561 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6580ca-a51d-4f86-8dc6-eb0fa7fae40c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:30.646843 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6580ca-a51d-4f86-8dc6-eb0fa7fae40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:30.648604 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-de6580ca-a51d-4f86-8dc6-eb0fa7fae40c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:30.658559 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6580ca-a51d-4f86-8dc6-eb0fa7fae40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:30.659980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6580ca-a51d-4f86-8dc6-eb0fa7fae40c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:30.668502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1393/2766] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:45:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:30.774277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389bd0-790f-4eda-a211-8a8356da9cbb None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:30.774750 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389bd0-790f-4eda-a211-8a8356da9cbb None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:30.774864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389bd0-790f-4eda-a211-8a8356da9cbb None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:30.776820 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1374/2767] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:45:30.783093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2d50-445e-48eb-a1f6-5f1a394d39e3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:30.783391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2d50-445e-48eb-a1f6-5f1a394d39e3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:30.783680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2d50-445e-48eb-a1f6-5f1a394d39e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:30.802058 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-718d2d50-445e-48eb-a1f6-5f1a394d39e3 None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:30.803280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-718d2d50-445e-48eb-a1f6-5f1a394d39e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:30.812785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1394/2768] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:45:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:30.825687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389bd0-790f-4eda-a211-8a8356da9cbb None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:30.837313 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389bd0-790f-4eda-a211-8a8356da9cbb None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:30.842000 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb9931-66c6-4b44-975f-392b9d889103 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:30.842276 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9931-66c6-4b44-975f-392b9d889103 service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:30.842692 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9931-66c6-4b44-975f-392b9d889103 service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:30.843013 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9931-66c6-4b44-975f-392b9d889103 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:30.853547 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb9931-66c6-4b44-975f-392b9d889103 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:30.854981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb9931-66c6-4b44-975f-392b9d889103 service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:30.866751 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1375/2769] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:45:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:30.947434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100ef9-18af-437a-9658-d70f5ff5eb3a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:30.947935 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100ef9-18af-437a-9658-d70f5ff5eb3a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:30.948196 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100ef9-18af-437a-9658-d70f5ff5eb3a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:30.949644 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1395/2770] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:45:30.954418 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a53fd-2470-4b55-a12e-8f8ae2dcea3d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:30.954797 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a53fd-2470-4b55-a12e-8f8ae2dcea3d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:30.955079 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a53fd-2470-4b55-a12e-8f8ae2dcea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:30.974163 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5d7a53fd-2470-4b55-a12e-8f8ae2dcea3d None None] MFA Rules not processed for user `ebee38389afb4270b18c6a14c7a4e302`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:30.975384 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5d7a53fd-2470-4b55-a12e-8f8ae2dcea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:30.985674 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1376/2771] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:45:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:45:30.998116 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d100ef9-18af-437a-9658-d70f5ff5eb3a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:31.010348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d100ef9-18af-437a-9658-d70f5ff5eb3a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:31.014378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163d907-138b-41f8-ad9d-2bf98d7c40a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:31.015378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d907-138b-41f8-ad9d-2bf98d7c40a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:31.015378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d907-138b-41f8-ad9d-2bf98d7c40a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:31.015592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d907-138b-41f8-ad9d-2bf98d7c40a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:31.024595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163d907-138b-41f8-ad9d-2bf98d7c40a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:31.026743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163d907-138b-41f8-ad9d-2bf98d7c40a3 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:31.035656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1396/2772] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:45:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:31.126761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a6d3-4fe4-404e-89c6-e697f21ce77e None None] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:31.127078 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a6d3-4fe4-404e-89c6-e697f21ce77e None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:31.127355 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a6d3-4fe4-404e-89c6-e697f21ce77e None None] PATH_INFO: `/` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:31.128723 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1377/2773] 10.222.0.79 () {54 vars in 921 bytes} [Fri May 27 09:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:45:31.134914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532396a-e942-4422-8eb8-59d1ead77568 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:31.135244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532396a-e942-4422-8eb8-59d1ead77568 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:31.135471 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532396a-e942-4422-8eb8-59d1ead77568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:31.155323 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6532396a-e942-4422-8eb8-59d1ead77568 None None] MFA Rules not processed for user `742917921213432a8ec7853ccf988fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:31.156526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6532396a-e942-4422-8eb8-59d1ead77568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:31.165875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1397/2774] 10.222.0.79 () {58 vars in 1018 bytes} [Fri May 27 09:45:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:45:31.176273 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a6d3-4fe4-404e-89c6-e697f21ce77e None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:31.188270 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a6d3-4fe4-404e-89c6-e697f21ce77e None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:31.191814 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b22db-2dc3-4b54-a134-1a3c1c882a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:31.192648 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b22db-2dc3-4b54-a134-1a3c1c882a1e service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:31.192950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b22db-2dc3-4b54-a134-1a3c1c882a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:31.193309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b22db-2dc3-4b54-a134-1a3c1c882a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:31.204145 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b22db-2dc3-4b54-a134-1a3c1c882a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:31.205682 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b22db-2dc3-4b54-a134-1a3c1c882a1e service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:31.216221 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1378/2775] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:45:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:34.324905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9d37-4f3c-4fc0-9655-3c8f69daad67 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:34.325352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9d37-4f3c-4fc0-9655-3c8f69daad67 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:34.325482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9d37-4f3c-4fc0-9655-3c8f69daad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:34.348710 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6a7b9d37-4f3c-4fc0-9655-3c8f69daad67 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:34.349940 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6a7b9d37-4f3c-4fc0-9655-3c8f69daad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:34.357027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1398/2776] 10.222.0.79 () {58 vars in 1009 bytes} [Fri May 27 09:45:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:34.369429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b22db-2dc3-4b54-a134-1a3c1c882a1e service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:34.380776 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b22db-2dc3-4b54-a134-1a3c1c882a1e service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:34.386443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4238b89-2a0b-4ae2-8a9b-8f50eb07ac8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:34.387098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4238b89-2a0b-4ae2-8a9b-8f50eb07ac8c service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:34.387381 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4238b89-2a0b-4ae2-8a9b-8f50eb07ac8c service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:34.387659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4238b89-2a0b-4ae2-8a9b-8f50eb07ac8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:34.396229 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4238b89-2a0b-4ae2-8a9b-8f50eb07ac8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:34.397850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4238b89-2a0b-4ae2-8a9b-8f50eb07ac8c service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:34.406606 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1379/2777] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:45:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:45:34.833916 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7286f-ae33-48c5-98ea-e1103c1a3d99 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:34.834213 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7286f-ae33-48c5-98ea-e1103c1a3d99 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:34.834496 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7286f-ae33-48c5-98ea-e1103c1a3d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:34.864274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-edb7286f-ae33-48c5-98ea-e1103c1a3d99 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:34.866205 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-edb7286f-ae33-48c5-98ea-e1103c1a3d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:34.884985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1399/2778] 10.222.0.79 () {58 vars in 967 bytes} [Fri May 27 09:45:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:34.904740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4238b89-2a0b-4ae2-8a9b-8f50eb07ac8c service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:34.917415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4238b89-2a0b-4ae2-8a9b-8f50eb07ac8c service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:34.923171 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6e63c-532c-444a-a497-31436539fb63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:34.923835 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6e63c-532c-444a-a497-31436539fb63 service swift] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:34.924121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6e63c-532c-444a-a497-31436539fb63 service swift] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:34.924401 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6e63c-532c-444a-a497-31436539fb63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:34.939073 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6e63c-532c-444a-a497-31436539fb63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:34.940896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6e63c-532c-444a-a497-31436539fb63 service swift] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:34.951174 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1380/2779] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:45:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:45:42.964639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7286f-ae33-48c5-98ea-e1103c1a3d99 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:42.979332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7286f-ae33-48c5-98ea-e1103c1a3d99 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:42.985373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:42.986274 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:42.986756 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:42.987529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:42.989715 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:43.003526 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:43.006639 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:43.020729 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1400/2780] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:45:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:43.041303 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6e63c-532c-444a-a497-31436539fb63 service swift] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:43.114214 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6e63c-532c-444a-a497-31436539fb63 service swift] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:43.119645 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:43.120527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:43.120816 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:43.121153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] PATH_INFO: `/v3/users/7f67d7eb2f8540ae80dbcb7aedf2ba8a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:43.122473 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f67d7eb2f8540ae80dbcb7aedf2ba8a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:43.124272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:43.160980 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:43.177107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f67d7eb2f8540ae80dbcb7aedf2ba8a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.189518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f67d7eb2f8540ae80dbcb7aedf2ba8a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.190216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f67d7eb2f8540ae80dbcb7aedf2ba8a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.198090 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f67d7eb2f8540ae80dbcb7aedf2ba8a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.198518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f67d7eb2f8540ae80dbcb7aedf2ba8a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.212659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1381/2781] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:45:43 2022] DELETE /identity/v3/users/7f67d7eb2f8540ae80dbcb7aedf2ba8a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:45:43.386787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:43.404781 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f40e8-5974-4820-8fc3-7a963180ff43 service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:43.465224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:43.466098 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:43.466385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:43.466920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] PATH_INFO: `/v3/projects/131620a4522846dbb6d681995a075da5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:43.468136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=131620a4522846dbb6d681995a075da5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:43.470108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:43.517081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131620a4522846dbb6d681995a075da5', 'request_id': 'req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.522506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131620a4522846dbb6d681995a075da5', 'request_id': 'req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.529216 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131620a4522846dbb6d681995a075da5', 'request_id': 'req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.541128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] The token cache is being invalidate because project 131620a4522846dbb6d681995a075da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:43.541415 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.542069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.543613 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1401/2782] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:45:43 2022] DELETE /identity/v3/projects/131620a4522846dbb6d681995a075da5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:43.547612 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:43.549210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:43.562555 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a569e-a2c6-4e3a-8757-6f267f18c682 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:43.618356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:43.619231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:43.619516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:43.619794 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] PATH_INFO: `/v3/users/e13c2cc89bd94d338d27aabc3ca3eb0d` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:43.621095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13c2cc89bd94d338d27aabc3ca3eb0d)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:43.623007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:43.667833 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13c2cc89bd94d338d27aabc3ca3eb0d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.679707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13c2cc89bd94d338d27aabc3ca3eb0d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.680380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13c2cc89bd94d338d27aabc3ca3eb0d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.687033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13c2cc89bd94d338d27aabc3ca3eb0d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.687743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-8b5a839f-81f2-4e4d-b6d2-85e11faaf166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13c2cc89bd94d338d27aabc3ca3eb0d'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:43.700483 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1382/2783] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:45:43 2022] DELETE /identity/v3/users/e13c2cc89bd94d338d27aabc3ca3eb0d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:45:43.870894 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:43.872341 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:43.885857 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60108f9-c37a-445f-9b3d-4a9a2fec8d2a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:43.906871 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:43.944443 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:43.945337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:43.945624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:43.945905 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] PATH_INFO: `/v3/projects/76ca6cffe48946c0bab5af96d50659b0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:43.947691 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ca6cffe48946c0bab5af96d50659b0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:43.949642 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:43.994834 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ca6cffe48946c0bab5af96d50659b0', 'request_id': 'req-57b602e2-5923-40cd-8459-ca1511f2b8f2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:44.000387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ca6cffe48946c0bab5af96d50659b0', 'request_id': 'req-57b602e2-5923-40cd-8459-ca1511f2b8f2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:44.006394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ca6cffe48946c0bab5af96d50659b0', 'request_id': 'req-57b602e2-5923-40cd-8459-ca1511f2b8f2'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:44.018974 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] The token cache is being invalidate because project 76ca6cffe48946c0bab5af96d50659b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:45:44.019261 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:44.019901 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:45:44.021449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1402/2784] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:45:43 2022] DELETE /identity/v3/projects/76ca6cffe48946c0bab5af96d50659b0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:46.748949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf24e0-c6cb-4575-9711-3894f5f46e58 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:46.749457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf24e0-c6cb-4575-9711-3894f5f46e58 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:46.749588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf24e0-c6cb-4575-9711-3894f5f46e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:46.767531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5ddf24e0-c6cb-4575-9711-3894f5f46e58 None None] MFA Rules not processed for user `8a346babd29541b4ae699731bc801b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:46.768761 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5ddf24e0-c6cb-4575-9711-3894f5f46e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:46.796783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:46.829778 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1383/2785] 10.222.0.79 () {58 vars in 967 bytes} [Fri May 27 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:46.842603 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:46.843990 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:46.911767 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b602e2-5923-40cd-8459-ca1511f2b8f2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:46.916594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d781e-1c92-4728-996a-adf2e5e9e94c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113f9a9f11014b9ba3efe6781615d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:46.917271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d781e-1c92-4728-996a-adf2e5e9e94c service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:46.917550 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d781e-1c92-4728-996a-adf2e5e9e94c service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:46.917823 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d781e-1c92-4728-996a-adf2e5e9e94c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:46.925658 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d781e-1c92-4728-996a-adf2e5e9e94c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:46.927230 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d781e-1c92-4728-996a-adf2e5e9e94c service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:46.935660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1403/2786] 10.222.0.79 () {60 vars in 1384 bytes} [Fri May 27 09:45:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:45:56.822947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=12 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:56.932482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:29.240104 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf24e0-c6cb-4575-9711-3894f5f46e58 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:29.242277 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5ddf24e0-c6cb-4575-9711-3894f5f46e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:29.314851 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf24e0-c6cb-4575-9711-3894f5f46e58 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:29.319638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:29.320520 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:29.320841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:29.321137 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] PATH_INFO: `/v3/users/72ba7e1e48df4d319dd472f33da41f2a` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:29.322351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ba7e1e48df4d319dd472f33da41f2a)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:29.324309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:29.371405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ba7e1e48df4d319dd472f33da41f2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.383136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ba7e1e48df4d319dd472f33da41f2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.383818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ba7e1e48df4d319dd472f33da41f2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.391238 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ba7e1e48df4d319dd472f33da41f2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.391910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-1c5ea025-0787-4197-ac82-82dbc05b60ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ba7e1e48df4d319dd472f33da41f2a'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.404500 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1384/2787] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:46:29 2022] DELETE /identity/v3/users/72ba7e1e48df4d319dd472f33da41f2a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:46:29.574040 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d781e-1c92-4728-996a-adf2e5e9e94c service swift] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:29.585128 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d781e-1c92-4728-996a-adf2e5e9e94c service swift] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:29.641654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:29.642507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:29.642787 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:29.643063 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] PATH_INFO: `/v3/projects/ec559a9e4b01471296925174799752ca` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:29.644224 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec559a9e4b01471296925174799752ca)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:29.646182 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:29.691168 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec559a9e4b01471296925174799752ca', 'request_id': 'req-8130cede-32d7-4746-8377-afd0098e67fe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.696648 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec559a9e4b01471296925174799752ca', 'request_id': 'req-8130cede-32d7-4746-8377-afd0098e67fe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.702803 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec559a9e4b01471296925174799752ca', 'request_id': 'req-8130cede-32d7-4746-8377-afd0098e67fe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.716277 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] The token cache is being invalidate because project ec559a9e4b01471296925174799752ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:46:29.716562 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.717215 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8130cede-32d7-4746-8377-afd0098e67fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:46:29.718985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1404/2788] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:46:29 2022] DELETE /identity/v3/projects/ec559a9e4b01471296925174799752ca => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:46:29.723981 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b01c6-7b32-4855-9a8f-ecc2d1de7c00 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:29.724265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b01c6-7b32-4855-9a8f-ecc2d1de7c00 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:29.724542 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b01c6-7b32-4855-9a8f-ecc2d1de7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:29.742363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-8d5b01c6-7b32-4855-9a8f-ecc2d1de7c00 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:29.743552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-8d5b01c6-7b32-4855-9a8f-ecc2d1de7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:29.801942 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1385/2789] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:29.809969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9618-e76f-4f2e-80c8-36c69cb7eb17 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:29.810342 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9618-e76f-4f2e-80c8-36c69cb7eb17 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:29.810665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9618-e76f-4f2e-80c8-36c69cb7eb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:29.828849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f87a9618-e76f-4f2e-80c8-36c69cb7eb17 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:29.830082 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f87a9618-e76f-4f2e-80c8-36c69cb7eb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:29.838039 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1405/2790] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:29.842949 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b01c6-7b32-4855-9a8f-ecc2d1de7c00 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:29.852643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b01c6-7b32-4855-9a8f-ecc2d1de7c00 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:29.858007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:29.858664 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:29.858953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:29.859236 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:29.859962 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:46:29.860272 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:29.861907 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:29.873382 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1386/2791] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:46:29.877615 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9618-e76f-4f2e-80c8-36c69cb7eb17 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:29.887037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9618-e76f-4f2e-80c8-36c69cb7eb17 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:29.891808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539feee-cc6b-4cb6-a6de-9f715485d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:29.892468 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539feee-cc6b-4cb6-a6de-9f715485d578 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:29.892751 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539feee-cc6b-4cb6-a6de-9f715485d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:29.893056 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539feee-cc6b-4cb6-a6de-9f715485d578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:29.893775 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539feee-cc6b-4cb6-a6de-9f715485d578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:29.895734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539feee-cc6b-4cb6-a6de-9f715485d578 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:29.921207 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1406/2792] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:46:29 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:46:29.925343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:29.935241 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80118cb9-26a9-4e27-892f-301e803812db admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:29.939049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:29.993267 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931230b-8589-4e83-9697-63fea9403ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:29.993858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931230b-8589-4e83-9697-63fea9403ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:29.994141 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931230b-8589-4e83-9697-63fea9403ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:29.994422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931230b-8589-4e83-9697-63fea9403ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:29.995098 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931230b-8589-4e83-9697-63fea9403ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:29.997027 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931230b-8589-4e83-9697-63fea9403ac2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:30.016653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1387/2793] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:46:29 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:46:30.020736 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539feee-cc6b-4cb6-a6de-9f715485d578 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:30.031668 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539feee-cc6b-4cb6-a6de-9f715485d578 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:30.036268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485c53-2503-4ff7-85b8-a551eef6aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:30.036966 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485c53-2503-4ff7-85b8-a551eef6aedf admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:30.037251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485c53-2503-4ff7-85b8-a551eef6aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:30.037529 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485c53-2503-4ff7-85b8-a551eef6aedf admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:30.038249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485c53-2503-4ff7-85b8-a551eef6aedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:30.039846 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485c53-2503-4ff7-85b8-a551eef6aedf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:30.050170 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1407/2794] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:46:30.054007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931230b-8589-4e83-9697-63fea9403ac2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:30.063829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931230b-8589-4e83-9697-63fea9403ac2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:30.068443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bc6e3-a292-42a2-b6f8-67093e0331ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:30.069136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc6e3-a292-42a2-b6f8-67093e0331ac admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:30.069423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc6e3-a292-42a2-b6f8-67093e0331ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:30.069699 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bc6e3-a292-42a2-b6f8-67093e0331ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:30.070420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bc6e3-a292-42a2-b6f8-67093e0331ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:30.072012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bc6e3-a292-42a2-b6f8-67093e0331ac admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:30.083655 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1388/2795] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:46:30.087534 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485c53-2503-4ff7-85b8-a551eef6aedf admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:30.098519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485c53-2503-4ff7-85b8-a551eef6aedf admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:30.103543 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:30.104423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:30.104704 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:30.105020 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] PATH_INFO: `/v3/projects/fc1db814dbfd473db1b2d30a1f04f5f8/users/a0ca150fd5134a0882c0cec199089947/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:30.121403 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1db814dbfd473db1b2d30a1f04f5f8, user_id=a0ca150fd5134a0882c0cec199089947, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:30.124108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:30.137784 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1408/2796] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:46:30 2022] PUT /identity/v3/projects/fc1db814dbfd473db1b2d30a1f04f5f8/users/a0ca150fd5134a0882c0cec199089947/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:46:30.142822 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b137-431b-42f3-bbf0-671c94a14a12 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:30.143121 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b137-431b-42f3-bbf0-671c94a14a12 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:30.143409 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b137-431b-42f3-bbf0-671c94a14a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:30.160740 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5f77b137-431b-42f3-bbf0-671c94a14a12 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:30.161967 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5f77b137-431b-42f3-bbf0-671c94a14a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:30.222539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1389/2797] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:30.232251 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:30.233985 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:30.264396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:30.292045 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df45f-13c8-4bf1-85c1-c6b0704f4345 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:30.295749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:30.296404 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:30.296681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:30.296996 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:30.306391 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:30.307836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:30.317446 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1409/2798] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:46:34.101801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3bddb-f528-4529-b536-004ccf282f76 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:34.102543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3bddb-f528-4529-b536-004ccf282f76 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:34.102845 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3bddb-f528-4529-b536-004ccf282f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:34.134088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-f0e3bddb-f528-4529-b536-004ccf282f76 None None] MFA Rules not processed for user `a0ca150fd5134a0882c0cec199089947`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:34.135630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-f0e3bddb-f528-4529-b536-004ccf282f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:34.209417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1390/2799] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:46:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:34.225325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:34.226930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:34.303641 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0d7af-0e9f-4679-8cbe-daf6cea5a77b service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:34.309513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:34.310199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:34.310502 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:34.310774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:34.319692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:34.321312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:34.330945 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1410/2800] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:46:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:46:36.989049 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3599b2-7088-4c49-95b6-fb361e2f4989 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:36.989557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3599b2-7088-4c49-95b6-fb361e2f4989 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:36.989673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3599b2-7088-4c49-95b6-fb361e2f4989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:37.010731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-5f3599b2-7088-4c49-95b6-fb361e2f4989 None None] MFA Rules not processed for user `a0ca150fd5134a0882c0cec199089947`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:37.012556 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-5f3599b2-7088-4c49-95b6-fb361e2f4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:37.021227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1391/2801] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:46:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:44.326500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=48 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:44.560166 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:44.561707 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:44.574427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a3c0d-25e5-4ade-8fd8-c33e249e84fa service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:44.578298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:44.579089 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:44.579424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:44.579695 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:44.581586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:44.596291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:44.597772 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:44.609291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1411/2802] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:46:45.781541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3599b2-7088-4c49-95b6-fb361e2f4989 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:45.791336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3599b2-7088-4c49-95b6-fb361e2f4989 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:45.795567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c4bde-3ed3-4573-a4cc-2d906700aa14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:45.796258 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c4bde-3ed3-4573-a4cc-2d906700aa14 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:45.796548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c4bde-3ed3-4573-a4cc-2d906700aa14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:45.796856 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c4bde-3ed3-4573-a4cc-2d906700aa14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:45.802826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-287c4bde-3ed3-4573-a4cc-2d906700aa14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:45.817896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:45.820437 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c4bde-3ed3-4573-a4cc-2d906700aa14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:45.822385 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c4bde-3ed3-4573-a4cc-2d906700aa14 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:45.833960 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1392/2803] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:46:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:46:54.603777 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:55.829114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=2 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:22.127984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:22.137884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fbe7b-274e-4429-9427-76eb9d760fe7 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:22.142228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:22.142917 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:22.143206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:22.143489 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:22.145350 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:22.155547 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:22.157145 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:22.165424 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1412/2804] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:48:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:32.161892 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:01.041727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d5a1-e9ea-41a4-bd8b-7958df3483cd None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.042292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d5a1-e9ea-41a4-bd8b-7958df3483cd None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.042292 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d5a1-e9ea-41a4-bd8b-7958df3483cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.072453 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-cd29d5a1-e9ea-41a4-bd8b-7958df3483cd None None] MFA Rules not processed for user `a0ca150fd5134a0882c0cec199089947`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:01.073709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-cd29d5a1-e9ea-41a4-bd8b-7958df3483cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:01.096912 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1393/2805] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:49:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:01.712022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:01.713499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:01.831720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e8fbe-4e4b-476f-a727-e8b1be6babec service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:01.836896 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:01.837601 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:01.837867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:01.838143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:01.839914 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:01.852336 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:01.853955 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:01.864291 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1413/2806] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:49:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:10.028583 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29d5a1-e9ea-41a4-bd8b-7958df3483cd None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:10.061183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29d5a1-e9ea-41a4-bd8b-7958df3483cd None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:10.066819 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:10.067469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:10.067759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:10.068035 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:10.069987 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:10.099077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:10.100714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:10.111407 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1394/2807] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:49:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:11.860037 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=48 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:13.187500 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:13.199732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b591-2191-4948-b070-c783f1cce026 service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:13.205315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '742917921213432a8ec7853ccf988fdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:13.205956 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:13.206240 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:13.206519 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:13.208256 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:13.220481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:13.222427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:13.233878 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1414/2808] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:49:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:20.106788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=33 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:23.228719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:09.867727 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:09.901950 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21179c79-640f-4681-b8b2-dc2d6a622f3f service nova] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:09.907490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:09.908449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:09.908734 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:09.909048 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] PATH_INFO: `/v3/users/a0ca150fd5134a0882c0cec199089947` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:09.910271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ca150fd5134a0882c0cec199089947)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:09.912209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:09.965493 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ca150fd5134a0882c0cec199089947'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:09.977995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ca150fd5134a0882c0cec199089947'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:09.978709 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ca150fd5134a0882c0cec199089947'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:09.985937 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ca150fd5134a0882c0cec199089947'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:09.986696 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-74ee302c-0451-4a0b-b9b1-50e80ae9c71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ca150fd5134a0882c0cec199089947'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:09.998909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1395/2809] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:50:09 2022] DELETE /identity/v3/users/a0ca150fd5134a0882c0cec199089947 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:10.167057 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:10.177975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef87d30-3b7d-4813-bebb-7dac22f0a9de service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:10.236397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:10.237280 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.237560 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.237832 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] PATH_INFO: `/v3/projects/fc1db814dbfd473db1b2d30a1f04f5f8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.239033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1db814dbfd473db1b2d30a1f04f5f8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:10.240970 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:10.286586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1db814dbfd473db1b2d30a1f04f5f8', 'request_id': 'req-fa198130-051a-4ba1-8110-3cef7f3fbafc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:10.292276 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1db814dbfd473db1b2d30a1f04f5f8', 'request_id': 'req-fa198130-051a-4ba1-8110-3cef7f3fbafc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:10.299087 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1db814dbfd473db1b2d30a1f04f5f8', 'request_id': 'req-fa198130-051a-4ba1-8110-3cef7f3fbafc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:10.323444 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] The token cache is being invalidate because project fc1db814dbfd473db1b2d30a1f04f5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:10.323732 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:10.324348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fa198130-051a-4ba1-8110-3cef7f3fbafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:10.325920 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1415/2810] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:50:10 2022] DELETE /identity/v3/projects/fc1db814dbfd473db1b2d30a1f04f5f8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:10.331469 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a7d3f-2342-445a-b3a4-77f6cbe68f5d None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.331763 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a7d3f-2342-445a-b3a4-77f6cbe68f5d None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.332047 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a7d3f-2342-445a-b3a4-77f6cbe68f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.386429 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-bb0a7d3f-2342-445a-b3a4-77f6cbe68f5d None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:10.387646 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-bb0a7d3f-2342-445a-b3a4-77f6cbe68f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:10.446487 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1396/2811] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:10.454232 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4bf17-c4b4-4352-954f-db81fbf9d106 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.454523 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4bf17-c4b4-4352-954f-db81fbf9d106 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.454808 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4bf17-c4b4-4352-954f-db81fbf9d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.473324 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9ea4bf17-c4b4-4352-954f-db81fbf9d106 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:10.474516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9ea4bf17-c4b4-4352-954f-db81fbf9d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:10.482372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1416/2812] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:10.486298 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a7d3f-2342-445a-b3a4-77f6cbe68f5d None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:10.495787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a7d3f-2342-445a-b3a4-77f6cbe68f5d None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:10.500353 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:10.501552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.501838 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.502119 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.502841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:50:10.503153 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:10.504745 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:10.516146 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1397/2813] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:50:10.520619 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4bf17-c4b4-4352-954f-db81fbf9d106 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:10.529794 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4bf17-c4b4-4352-954f-db81fbf9d106 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:10.534499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65a769-ba3a-4739-834f-6a285f1792ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:10.535141 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a769-ba3a-4739-834f-6a285f1792ee admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.535425 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a769-ba3a-4739-834f-6a285f1792ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.535726 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a769-ba3a-4739-834f-6a285f1792ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.536472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65a769-ba3a-4739-834f-6a285f1792ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:10.538427 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65a769-ba3a-4739-834f-6a285f1792ee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:10.567413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1417/2814] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:50:10 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:10.571626 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:10.588890 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba8a68-f8b8-41bb-98fc-3af33adba6f0 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:10.591191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:10.641112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10825bdd-4baa-4254-88b4-49be7ec1963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:10.642343 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10825bdd-4baa-4254-88b4-49be7ec1963d admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.642632 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10825bdd-4baa-4254-88b4-49be7ec1963d admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.642919 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10825bdd-4baa-4254-88b4-49be7ec1963d admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.643611 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10825bdd-4baa-4254-88b4-49be7ec1963d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:10.645736 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10825bdd-4baa-4254-88b4-49be7ec1963d admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:10.665752 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1398/2815] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:50:10 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:10.669868 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65a769-ba3a-4739-834f-6a285f1792ee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:10.680406 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65a769-ba3a-4739-834f-6a285f1792ee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:10.685092 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf7220-2e8b-43ab-b8f0-2220851c5076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:10.685749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7220-2e8b-43ab-b8f0-2220851c5076 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.686066 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7220-2e8b-43ab-b8f0-2220851c5076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.686348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7220-2e8b-43ab-b8f0-2220851c5076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.687072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf7220-2e8b-43ab-b8f0-2220851c5076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:10.689228 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf7220-2e8b-43ab-b8f0-2220851c5076 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:10.700073 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1418/2816] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:10.704610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10825bdd-4baa-4254-88b4-49be7ec1963d admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:10.715010 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10825bdd-4baa-4254-88b4-49be7ec1963d admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:10.719666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f43d2e-c41e-4a89-b444-615545722044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:10.720324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43d2e-c41e-4a89-b444-615545722044 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.720627 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43d2e-c41e-4a89-b444-615545722044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.720920 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43d2e-c41e-4a89-b444-615545722044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.722178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f43d2e-c41e-4a89-b444-615545722044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:10.723783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f43d2e-c41e-4a89-b444-615545722044 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:10.736142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1399/2817] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:10.740268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf7220-2e8b-43ab-b8f0-2220851c5076 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:10.750326 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf7220-2e8b-43ab-b8f0-2220851c5076 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:10.756348 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a12a24-2df5-4ea0-bfac-d14cca137a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:10.757260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12a24-2df5-4ea0-bfac-d14cca137a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.757535 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12a24-2df5-4ea0-bfac-d14cca137a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.757807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12a24-2df5-4ea0-bfac-d14cca137a0b admin admin] PATH_INFO: `/v3/projects/045742d939fc49c19d6403f6c204d8ae/users/4f7486dc761a4ccf978829a79873ee4f/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.772461 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a12a24-2df5-4ea0-bfac-d14cca137a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=045742d939fc49c19d6403f6c204d8ae, user_id=4f7486dc761a4ccf978829a79873ee4f, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:10.775175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a12a24-2df5-4ea0-bfac-d14cca137a0b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:10.788673 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1419/2818] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:10 2022] PUT /identity/v3/projects/045742d939fc49c19d6403f6c204d8ae/users/4f7486dc761a4ccf978829a79873ee4f/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:10.799659 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857172d1-9852-43e8-9ba7-fe587607b2e7 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.799946 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857172d1-9852-43e8-9ba7-fe587607b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.800231 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857172d1-9852-43e8-9ba7-fe587607b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.827551 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-857172d1-9852-43e8-9ba7-fe587607b2e7 None None] MFA Rules not processed for user `4f7486dc761a4ccf978829a79873ee4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:10.828809 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-857172d1-9852-43e8-9ba7-fe587607b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:10.896095 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1400/2819] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:50:10.900685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a12a24-2df5-4ea0-bfac-d14cca137a0b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:10.921022 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:10.970836 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a12a24-2df5-4ea0-bfac-d14cca137a0b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:10.975915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3eb3f-ed81-4361-afaf-4390adec25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:10.976586 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3eb3f-ed81-4361-afaf-4390adec25d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:10.976900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3eb3f-ed81-4361-afaf-4390adec25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:10.977185 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3eb3f-ed81-4361-afaf-4390adec25d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:10.977930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3eb3f-ed81-4361-afaf-4390adec25d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:10.979877 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3eb3f-ed81-4361-afaf-4390adec25d7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.007888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1420/2820] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:50:10 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:50:11.011943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857172d1-9852-43e8-9ba7-fe587607b2e7 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.022964 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857172d1-9852-43e8-9ba7-fe587607b2e7 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.080220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7090b2a-c458-4792-ade2-fd004509f5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.080935 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7090b2a-c458-4792-ade2-fd004509f5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.081222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7090b2a-c458-4792-ade2-fd004509f5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.081499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7090b2a-c458-4792-ade2-fd004509f5cb admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.082183 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7090b2a-c458-4792-ade2-fd004509f5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.084118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7090b2a-c458-4792-ade2-fd004509f5cb admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.105509 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1401/2821] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:50:11 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:11.109552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3eb3f-ed81-4361-afaf-4390adec25d7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.120538 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3eb3f-ed81-4361-afaf-4390adec25d7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.125313 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1aca8-c4ed-425b-afa9-a2a9e4e282b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.126005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1aca8-c4ed-425b-afa9-a2a9e4e282b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.126289 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1aca8-c4ed-425b-afa9-a2a9e4e282b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.126570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1aca8-c4ed-425b-afa9-a2a9e4e282b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.127327 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1aca8-c4ed-425b-afa9-a2a9e4e282b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.129013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1aca8-c4ed-425b-afa9-a2a9e4e282b8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.140693 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1421/2822] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:11.144998 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7090b2a-c458-4792-ade2-fd004509f5cb admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.155106 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7090b2a-c458-4792-ade2-fd004509f5cb admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.160311 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676978d-3658-4da7-86b5-18b22e37764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.161228 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676978d-3658-4da7-86b5-18b22e37764f admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.161516 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676978d-3658-4da7-86b5-18b22e37764f admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.161802 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676978d-3658-4da7-86b5-18b22e37764f admin admin] PATH_INFO: `/v3/projects/2052678ef20b4fcc85e248425ee30f9b/users/454d90d688d044abb94226da2035dcc1/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.170391 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:11.178841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676978d-3658-4da7-86b5-18b22e37764f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2052678ef20b4fcc85e248425ee30f9b, user_id=454d90d688d044abb94226da2035dcc1, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.181853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676978d-3658-4da7-86b5-18b22e37764f admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.194610 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1402/2823] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:11 2022] PUT /identity/v3/projects/2052678ef20b4fcc85e248425ee30f9b/users/454d90d688d044abb94226da2035dcc1/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:11.199507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1aca8-c4ed-425b-afa9-a2a9e4e282b8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.211148 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1aca8-c4ed-425b-afa9-a2a9e4e282b8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.267697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f03e4-5de2-40fc-8ee6-90d213bb146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.268414 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f03e4-5de2-40fc-8ee6-90d213bb146d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.268701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f03e4-5de2-40fc-8ee6-90d213bb146d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.269014 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f03e4-5de2-40fc-8ee6-90d213bb146d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.269744 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f03e4-5de2-40fc-8ee6-90d213bb146d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.271521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f03e4-5de2-40fc-8ee6-90d213bb146d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.281345 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1422/2824] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:11.286172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676978d-3658-4da7-86b5-18b22e37764f admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.296725 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676978d-3658-4da7-86b5-18b22e37764f admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.302234 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.303136 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.303417 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.304446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] PATH_INFO: `/v3/projects/2052678ef20b4fcc85e248425ee30f9b/users/454d90d688d044abb94226da2035dcc1/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.305743 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2052678ef20b4fcc85e248425ee30f9b, user_id=454d90d688d044abb94226da2035dcc1, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.308438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.319284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1403/2825] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:11 2022] PUT /identity/v3/projects/2052678ef20b4fcc85e248425ee30f9b/users/454d90d688d044abb94226da2035dcc1/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:11.330859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b09c86-9d18-4856-808a-7ea87c44966f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.331155 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b09c86-9d18-4856-808a-7ea87c44966f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.331436 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b09c86-9d18-4856-808a-7ea87c44966f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.358320 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-27b09c86-9d18-4856-808a-7ea87c44966f None None] MFA Rules not processed for user `454d90d688d044abb94226da2035dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:11.359563 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-27b09c86-9d18-4856-808a-7ea87c44966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:11.427110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1423/2826] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:11.438476 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.440201 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:11.519036 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fa7a2-9f16-46b9-9a51-3c8de97179c9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.522689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93351109-5fdd-45ab-8018-b315d3c176fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.523336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93351109-5fdd-45ab-8018-b315d3c176fa service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.523625 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93351109-5fdd-45ab-8018-b315d3c176fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.523910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93351109-5fdd-45ab-8018-b315d3c176fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.533705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93351109-5fdd-45ab-8018-b315d3c176fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.535130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93351109-5fdd-45ab-8018-b315d3c176fa service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.544394 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1404/2827] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:11.616514 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b09c86-9d18-4856-808a-7ea87c44966f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.626549 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b09c86-9d18-4856-808a-7ea87c44966f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.630229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2fcb-e07f-4878-a793-e0ba86984b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.630874 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2fcb-e07f-4878-a793-e0ba86984b08 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.631159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2fcb-e07f-4878-a793-e0ba86984b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.631439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2fcb-e07f-4878-a793-e0ba86984b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.639785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:11.688371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2fcb-e07f-4878-a793-e0ba86984b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.689850 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2fcb-e07f-4878-a793-e0ba86984b08 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.698724 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1424/2828] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:18.357759 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93351109-5fdd-45ab-8018-b315d3c176fa service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:18.418354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93351109-5fdd-45ab-8018-b315d3c176fa service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:18.422899 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:18.423765 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:18.424051 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:18.424327 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] PATH_INFO: `/v3/users/4f7486dc761a4ccf978829a79873ee4f` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:18.425535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7486dc761a4ccf978829a79873ee4f)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:18.427451 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:18.472965 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7486dc761a4ccf978829a79873ee4f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:18.480362 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:18.485541 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7486dc761a4ccf978829a79873ee4f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:18.486280 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7486dc761a4ccf978829a79873ee4f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:18.494005 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7486dc761a4ccf978829a79873ee4f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:18.494618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7486dc761a4ccf978829a79873ee4f'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:18.506471 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1405/2829] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:50:18 2022] DELETE /identity/v3/users/4f7486dc761a4ccf978829a79873ee4f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:18.510999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe814-bd65-4673-9ba1-629770f20a01 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:18.511494 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe814-bd65-4673-9ba1-629770f20a01 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:18.511597 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe814-bd65-4673-9ba1-629770f20a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:18.529318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-52cbe814-bd65-4673-9ba1-629770f20a01 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:18.530504 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-52cbe814-bd65-4673-9ba1-629770f20a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:18.586435 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1425/2830] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:50:18.596072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:18.597789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:18.673326 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54515bd8-e0d2-4dc9-bd36-784c43e4408c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:18.677068 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da033819-4689-4bba-9211-bbf32fc26797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:18.677717 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033819-4689-4bba-9211-bbf32fc26797 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:18.678006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033819-4689-4bba-9211-bbf32fc26797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:18.678287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033819-4689-4bba-9211-bbf32fc26797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:18.687589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da033819-4689-4bba-9211-bbf32fc26797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:18.689062 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da033819-4689-4bba-9211-bbf32fc26797 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:18.699026 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1406/2831] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:18.969198 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbe814-bd65-4673-9ba1-629770f20a01 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:18.971172 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-52cbe814-bd65-4673-9ba1-629770f20a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:18.984472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbe814-bd65-4673-9ba1-629770f20a01 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:18.989978 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:18.990863 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:18.991121 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:18.991400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] PATH_INFO: `/v3/projects/045742d939fc49c19d6403f6c204d8ae` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:18.992581 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=045742d939fc49c19d6403f6c204d8ae)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:18.994624 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:19.040125 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045742d939fc49c19d6403f6c204d8ae', 'request_id': 'req-66b4070e-7865-4d25-b9d3-f3e94efafde3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.045371 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045742d939fc49c19d6403f6c204d8ae', 'request_id': 'req-66b4070e-7865-4d25-b9d3-f3e94efafde3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.051983 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045742d939fc49c19d6403f6c204d8ae', 'request_id': 'req-66b4070e-7865-4d25-b9d3-f3e94efafde3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.063689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] The token cache is being invalidate because project 045742d939fc49c19d6403f6c204d8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:19.063975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.064609 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.066157 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1426/2832] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:50:18 2022] DELETE /identity/v3/projects/045742d939fc49c19d6403f6c204d8ae => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:19.070190 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da033819-4689-4bba-9211-bbf32fc26797 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:19.079479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da033819-4689-4bba-9211-bbf32fc26797 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:19.134689 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:19.135557 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.135837 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.136114 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] PATH_INFO: `/v3/users/454d90d688d044abb94226da2035dcc1` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.137364 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454d90d688d044abb94226da2035dcc1)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:19.139351 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:19.183588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454d90d688d044abb94226da2035dcc1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.193576 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:19.195926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454d90d688d044abb94226da2035dcc1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.196845 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454d90d688d044abb94226da2035dcc1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.204623 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454d90d688d044abb94226da2035dcc1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.205575 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-6e9d8e9e-0df7-4d61-8452-dc77860b4a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454d90d688d044abb94226da2035dcc1'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.217880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1407/2833] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:50:19 2022] DELETE /identity/v3/users/454d90d688d044abb94226da2035dcc1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:19.479035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:19.480445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:19.493127 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4070e-7865-4d25-b9d3-f3e94efafde3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:19.524819 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:19.552588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:19.553483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.553817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.554046 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] PATH_INFO: `/v3/projects/2052678ef20b4fcc85e248425ee30f9b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.555210 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2052678ef20b4fcc85e248425ee30f9b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:19.557159 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:19.602475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2052678ef20b4fcc85e248425ee30f9b', 'request_id': 'req-2050a7bc-480e-48bf-ba80-5073ab91c24b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.607856 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2052678ef20b4fcc85e248425ee30f9b', 'request_id': 'req-2050a7bc-480e-48bf-ba80-5073ab91c24b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.614110 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2052678ef20b4fcc85e248425ee30f9b', 'request_id': 'req-2050a7bc-480e-48bf-ba80-5073ab91c24b'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.626816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] The token cache is being invalidate because project 2052678ef20b4fcc85e248425ee30f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:19.627104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.627791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2050a7bc-480e-48bf-ba80-5073ab91c24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:19.629575 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1427/2834] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:50:19 2022] DELETE /identity/v3/projects/2052678ef20b4fcc85e248425ee30f9b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:19.634463 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7685e-ff02-4d13-8dfa-3d699ee501ec None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.634953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7685e-ff02-4d13-8dfa-3d699ee501ec None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.635059 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7685e-ff02-4d13-8dfa-3d699ee501ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.653007 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-80c7685e-ff02-4d13-8dfa-3d699ee501ec None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:19.654227 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-80c7685e-ff02-4d13-8dfa-3d699ee501ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:19.713979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1408/2835] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:50:19.722758 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cbf5d-915e-4a5d-b6dc-80a15b1158fe None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.723051 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cbf5d-915e-4a5d-b6dc-80a15b1158fe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.723331 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cbf5d-915e-4a5d-b6dc-80a15b1158fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.741464 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-737cbf5d-915e-4a5d-b6dc-80a15b1158fe None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:19.742676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-737cbf5d-915e-4a5d-b6dc-80a15b1158fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:19.750574 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1428/2836] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:19.755081 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7685e-ff02-4d13-8dfa-3d699ee501ec None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:19.764494 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7685e-ff02-4d13-8dfa-3d699ee501ec None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:19.769704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:19.770345 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.770624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.770897 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.771613 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:50:19.771918 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:19.773546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:19.784713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1409/2837] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:50:19.788925 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cbf5d-915e-4a5d-b6dc-80a15b1158fe None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:19.798352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cbf5d-915e-4a5d-b6dc-80a15b1158fe None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:19.803035 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166be18a-b97b-4a97-ba50-112795456bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:19.803680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166be18a-b97b-4a97-ba50-112795456bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.804018 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166be18a-b97b-4a97-ba50-112795456bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.804252 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166be18a-b97b-4a97-ba50-112795456bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.804984 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166be18a-b97b-4a97-ba50-112795456bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:19.806934 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166be18a-b97b-4a97-ba50-112795456bb0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:19.833202 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1429/2838] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:50:19 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:19.837061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:19.847179 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c99f8-2067-4920-b68b-40fb137c6925 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:19.901275 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a458a-599f-4455-9a70-6ae5a671e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:19.901953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a458a-599f-4455-9a70-6ae5a671e46b admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.902216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a458a-599f-4455-9a70-6ae5a671e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.902491 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a458a-599f-4455-9a70-6ae5a671e46b admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.903165 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a458a-599f-4455-9a70-6ae5a671e46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:19.905088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a458a-599f-4455-9a70-6ae5a671e46b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:19.925862 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1410/2839] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:50:19 2022] POST /identity/v3/users => generated 278 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:50:19.929396 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166be18a-b97b-4a97-ba50-112795456bb0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:19.940062 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166be18a-b97b-4a97-ba50-112795456bb0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:19.944623 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177b79-efa2-4275-96c1-e18e71c6e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:19.945315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177b79-efa2-4275-96c1-e18e71c6e4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.945598 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177b79-efa2-4275-96c1-e18e71c6e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.945875 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177b79-efa2-4275-96c1-e18e71c6e4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.946593 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177b79-efa2-4275-96c1-e18e71c6e4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:19.948193 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177b79-efa2-4275-96c1-e18e71c6e4b6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:19.959284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1430/2840] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:19.962898 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a458a-599f-4455-9a70-6ae5a671e46b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:19.973040 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a458a-599f-4455-9a70-6ae5a671e46b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:19.977653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c51ca3-aca6-4565-b7bd-c2a6d9a6e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:19.978300 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c51ca3-aca6-4565-b7bd-c2a6d9a6e548 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:19.978585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c51ca3-aca6-4565-b7bd-c2a6d9a6e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:19.978864 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c51ca3-aca6-4565-b7bd-c2a6d9a6e548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:19.979581 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c51ca3-aca6-4565-b7bd-c2a6d9a6e548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:19.981210 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c51ca3-aca6-4565-b7bd-c2a6d9a6e548 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:19.990871 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1411/2841] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:50:19.994788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177b79-efa2-4275-96c1-e18e71c6e4b6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.005099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177b79-efa2-4275-96c1-e18e71c6e4b6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.009632 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bd84-ffbc-4c97-974d-795702097ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.010488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bd84-ffbc-4c97-974d-795702097ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.010765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bd84-ffbc-4c97-974d-795702097ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.011042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bd84-ffbc-4c97-974d-795702097ea2 admin admin] PATH_INFO: `/v3/projects/d5b4ccfb9f2a4c9d9d5a32e6a38e92bb/users/d98afd3a1c464aa2837d0dc2a6e40d08/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.027332 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15bd84-ffbc-4c97-974d-795702097ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b4ccfb9f2a4c9d9d5a32e6a38e92bb, user_id=d98afd3a1c464aa2837d0dc2a6e40d08, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.030055 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15bd84-ffbc-4c97-974d-795702097ea2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.042413 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1431/2842] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:19 2022] PUT /identity/v3/projects/d5b4ccfb9f2a4c9d9d5a32e6a38e92bb/users/d98afd3a1c464aa2837d0dc2a6e40d08/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:50:20.053951 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb5b7-7a70-457f-b8cd-a14373e2df23 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.054293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb5b7-7a70-457f-b8cd-a14373e2df23 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.054524 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb5b7-7a70-457f-b8cd-a14373e2df23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.081246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-3b8fb5b7-7a70-457f-b8cd-a14373e2df23 None None] MFA Rules not processed for user `d98afd3a1c464aa2837d0dc2a6e40d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:20.082438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-3b8fb5b7-7a70-457f-b8cd-a14373e2df23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:20.114420 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:20.148246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1412/2843] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:20 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:20.152674 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bd84-ffbc-4c97-974d-795702097ea2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.211903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bd84-ffbc-4c97-974d-795702097ea2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.216485 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97da29-fc97-459f-ab28-1fa4e341f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.217160 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97da29-fc97-459f-ab28-1fa4e341f90a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.217449 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97da29-fc97-459f-ab28-1fa4e341f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.217719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97da29-fc97-459f-ab28-1fa4e341f90a admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.218409 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97da29-fc97-459f-ab28-1fa4e341f90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.220287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97da29-fc97-459f-ab28-1fa4e341f90a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.223731 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:20.247223 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1432/2844] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:50:20 2022] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:50:20.251428 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb5b7-7a70-457f-b8cd-a14373e2df23 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.262649 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb5b7-7a70-457f-b8cd-a14373e2df23 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.318620 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77633f-487c-46f7-bf62-8dc086ea0dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.319232 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77633f-487c-46f7-bf62-8dc086ea0dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.319518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77633f-487c-46f7-bf62-8dc086ea0dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.319799 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77633f-487c-46f7-bf62-8dc086ea0dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.320499 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77633f-487c-46f7-bf62-8dc086ea0dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.322465 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77633f-487c-46f7-bf62-8dc086ea0dd2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.341173 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1413/2845] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:50:20 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:50:20.345165 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97da29-fc97-459f-ab28-1fa4e341f90a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.355487 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97da29-fc97-459f-ab28-1fa4e341f90a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.359930 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d232aa-82c9-4d0a-b5bf-8f404582c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.360576 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d232aa-82c9-4d0a-b5bf-8f404582c4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.360887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d232aa-82c9-4d0a-b5bf-8f404582c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.361722 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d232aa-82c9-4d0a-b5bf-8f404582c4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.362439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d232aa-82c9-4d0a-b5bf-8f404582c4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.364027 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d232aa-82c9-4d0a-b5bf-8f404582c4a6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.374235 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1433/2846] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:20.378832 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77633f-487c-46f7-bf62-8dc086ea0dd2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.388643 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77633f-487c-46f7-bf62-8dc086ea0dd2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.393269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ff9e2-0b09-404e-b2ff-6fd4933301aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.394143 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ff9e2-0b09-404e-b2ff-6fd4933301aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.394436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ff9e2-0b09-404e-b2ff-6fd4933301aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.394716 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ff9e2-0b09-404e-b2ff-6fd4933301aa admin admin] PATH_INFO: `/v3/projects/1a627f26ef1e4700a34b41885f27cb09/users/79073120e9cb418c9124afd887dbfe9e/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.409082 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ff9e2-0b09-404e-b2ff-6fd4933301aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a627f26ef1e4700a34b41885f27cb09, user_id=79073120e9cb418c9124afd887dbfe9e, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.411742 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ff9e2-0b09-404e-b2ff-6fd4933301aa admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.424559 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1414/2847] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:20 2022] PUT /identity/v3/projects/1a627f26ef1e4700a34b41885f27cb09/users/79073120e9cb418c9124afd887dbfe9e/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:20.428531 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d232aa-82c9-4d0a-b5bf-8f404582c4a6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.438305 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d232aa-82c9-4d0a-b5bf-8f404582c4a6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.494104 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df357cd7-bd4d-459f-b7bf-c389448dcdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.494770 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357cd7-bd4d-459f-b7bf-c389448dcdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.495059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357cd7-bd4d-459f-b7bf-c389448dcdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.495340 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357cd7-bd4d-459f-b7bf-c389448dcdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.496059 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df357cd7-bd4d-459f-b7bf-c389448dcdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.497697 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df357cd7-bd4d-459f-b7bf-c389448dcdd2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.507255 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1434/2848] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:20.511271 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ff9e2-0b09-404e-b2ff-6fd4933301aa admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.521357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ff9e2-0b09-404e-b2ff-6fd4933301aa admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.525967 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.526829 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.527110 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.527387 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] PATH_INFO: `/v3/projects/1a627f26ef1e4700a34b41885f27cb09/users/79073120e9cb418c9124afd887dbfe9e/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.529392 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a627f26ef1e4700a34b41885f27cb09, user_id=79073120e9cb418c9124afd887dbfe9e, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.532043 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.542788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1415/2849] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:20 2022] PUT /identity/v3/projects/1a627f26ef1e4700a34b41885f27cb09/users/79073120e9cb418c9124afd887dbfe9e/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:50:20.553287 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da9e15-7df2-4883-8c8d-dcb3b68696bf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.553790 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da9e15-7df2-4883-8c8d-dcb3b68696bf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.553904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da9e15-7df2-4883-8c8d-dcb3b68696bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.579312 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-77da9e15-7df2-4883-8c8d-dcb3b68696bf None None] MFA Rules not processed for user `79073120e9cb418c9124afd887dbfe9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:20.580452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-77da9e15-7df2-4883-8c8d-dcb3b68696bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:20.647245 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1435/2850] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:20 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:50:20.659064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.660782 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:20.716926 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6187a-3d5e-4c5e-99eb-b2fdbcdbf5c6 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.721092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e97f6-2403-43b0-af53-59a609d08be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.721988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e97f6-2403-43b0-af53-59a609d08be9 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.722270 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e97f6-2403-43b0-af53-59a609d08be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.722540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e97f6-2403-43b0-af53-59a609d08be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.731624 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e97f6-2403-43b0-af53-59a609d08be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.733088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e97f6-2403-43b0-af53-59a609d08be9 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.742940 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1416/2851] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:20.816294 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da9e15-7df2-4883-8c8d-dcb3b68696bf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:20.825870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da9e15-7df2-4883-8c8d-dcb3b68696bf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:20.829521 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc96f-aa03-4377-b762-544ca542dde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:20.830749 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc96f-aa03-4377-b762-544ca542dde7 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:20.831038 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc96f-aa03-4377-b762-544ca542dde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:20.831314 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc96f-aa03-4377-b762-544ca542dde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:20.884013 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:20.888600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafc96f-aa03-4377-b762-544ca542dde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:20.890507 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafc96f-aa03-4377-b762-544ca542dde7 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:20.899452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1436/2852] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:20 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:30.738830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:30.895411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:35.653284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e97f6-2403-43b0-af53-59a609d08be9 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:35.715490 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e97f6-2403-43b0-af53-59a609d08be9 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:35.719850 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:35.721282 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:35.721564 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:35.722099 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] PATH_INFO: `/v3/users/d98afd3a1c464aa2837d0dc2a6e40d08` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:35.723398 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98afd3a1c464aa2837d0dc2a6e40d08)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:35.725357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:35.772653 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98afd3a1c464aa2837d0dc2a6e40d08'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:35.785294 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98afd3a1c464aa2837d0dc2a6e40d08'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:35.785988 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98afd3a1c464aa2837d0dc2a6e40d08'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:35.793533 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98afd3a1c464aa2837d0dc2a6e40d08'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:35.794152 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98afd3a1c464aa2837d0dc2a6e40d08'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:35.807181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1417/2853] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:50:35 2022] DELETE /identity/v3/users/d98afd3a1c464aa2837d0dc2a6e40d08 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:35.811608 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc484d-fd17-4dbe-b5cc-e1a083a8c904 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:35.812109 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc484d-fd17-4dbe-b5cc-e1a083a8c904 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:35.812229 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc484d-fd17-4dbe-b5cc-e1a083a8c904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:35.829643 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d2dc484d-fd17-4dbe-b5cc-e1a083a8c904 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:35.830719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d2dc484d-fd17-4dbe-b5cc-e1a083a8c904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:35.887969 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1437/2854] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:35.898206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:35.899607 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:35.955979 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f161151-37e0-45e2-9116-0f7040e55160 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:35.959670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686ea1-90a3-4d38-b070-22f6af419823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:35.960310 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686ea1-90a3-4d38-b070-22f6af419823 service neutron] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:35.960596 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686ea1-90a3-4d38-b070-22f6af419823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:35.960909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686ea1-90a3-4d38-b070-22f6af419823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:35.969880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686ea1-90a3-4d38-b070-22f6af419823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:35.972164 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686ea1-90a3-4d38-b070-22f6af419823 service neutron] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:35.981518 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1418/2855] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:36.242375 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc484d-fd17-4dbe-b5cc-e1a083a8c904 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:36.243887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d2dc484d-fd17-4dbe-b5cc-e1a083a8c904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:36.256595 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc484d-fd17-4dbe-b5cc-e1a083a8c904 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:36.261268 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:36.262130 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:36.262417 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:36.262696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] PATH_INFO: `/v3/projects/d5b4ccfb9f2a4c9d9d5a32e6a38e92bb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:36.263886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b4ccfb9f2a4c9d9d5a32e6a38e92bb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:36.265841 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:36.317757 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b4ccfb9f2a4c9d9d5a32e6a38e92bb', 'request_id': 'req-5df0f697-1578-403d-96b3-ca5a57382305'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.323188 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b4ccfb9f2a4c9d9d5a32e6a38e92bb', 'request_id': 'req-5df0f697-1578-403d-96b3-ca5a57382305'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.329271 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b4ccfb9f2a4c9d9d5a32e6a38e92bb', 'request_id': 'req-5df0f697-1578-403d-96b3-ca5a57382305'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.342123 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] The token cache is being invalidate because project d5b4ccfb9f2a4c9d9d5a32e6a38e92bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:36.342414 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.343149 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.344696 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1438/2856] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:50:36 2022] DELETE /identity/v3/projects/d5b4ccfb9f2a4c9d9d5a32e6a38e92bb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:36.348947 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686ea1-90a3-4d38-b070-22f6af419823 service neutron] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:36.358319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686ea1-90a3-4d38-b070-22f6af419823 service neutron] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:36.375818 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:36.415905 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:36.416771 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:36.417077 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:36.417352 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] PATH_INFO: `/v3/users/79073120e9cb418c9124afd887dbfe9e` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:36.418531 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79073120e9cb418c9124afd887dbfe9e)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:36.420454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:36.465135 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79073120e9cb418c9124afd887dbfe9e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.476753 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79073120e9cb418c9124afd887dbfe9e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.477446 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79073120e9cb418c9124afd887dbfe9e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.484572 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79073120e9cb418c9124afd887dbfe9e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.485203 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-b9255f44-a15c-4ba9-80a5-855aa9e7d7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79073120e9cb418c9124afd887dbfe9e'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.497199 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1419/2857] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:50:36 2022] DELETE /identity/v3/users/79073120e9cb418c9124afd887dbfe9e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:36.764364 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:36.765847 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:36.786520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0f697-1578-403d-96b3-ca5a57382305 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:36.842275 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:36.843134 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:36.843416 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:36.843692 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] PATH_INFO: `/v3/projects/1a627f26ef1e4700a34b41885f27cb09` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:36.844903 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a627f26ef1e4700a34b41885f27cb09)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:36.847655 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:36.877788 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:36.895804 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a627f26ef1e4700a34b41885f27cb09', 'request_id': 'req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.901079 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a627f26ef1e4700a34b41885f27cb09', 'request_id': 'req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.907015 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a627f26ef1e4700a34b41885f27cb09', 'request_id': 'req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.919760 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] The token cache is being invalidate because project 1a627f26ef1e4700a34b41885f27cb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:36.920042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.920660 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e51abc7-ee02-45ae-9be3-deabbae5dcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:36.922220 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1439/2858] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:50:36 2022] DELETE /identity/v3/projects/1a627f26ef1e4700a34b41885f27cb09 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:36.927405 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7f8e-7692-4a21-aca3-776d1c5c7a4b None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:36.927943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7f8e-7692-4a21-aca3-776d1c5c7a4b None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:36.927943 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7f8e-7692-4a21-aca3-776d1c5c7a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:36.947001 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d03f7f8e-7692-4a21-aca3-776d1c5c7a4b None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:36.948186 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d03f7f8e-7692-4a21-aca3-776d1c5c7a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:37.005248 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1420/2859] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:37.013001 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4e90-c575-4728-9fe4-09c205cf3491 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.013298 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4e90-c575-4728-9fe4-09c205cf3491 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.013584 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4e90-c575-4728-9fe4-09c205cf3491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.033146 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5ced4e90-c575-4728-9fe4-09c205cf3491 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:37.034356 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5ced4e90-c575-4728-9fe4-09c205cf3491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:37.042315 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1440/2860] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:37.046307 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7f8e-7692-4a21-aca3-776d1c5c7a4b None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.055826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7f8e-7692-4a21-aca3-776d1c5c7a4b None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.060325 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.061021 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.061284 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.061554 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] PATH_INFO: `/v3/domains` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.062269 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:50:37.062567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.064703 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.075909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1421/2861] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:50:37.080606 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4e90-c575-4728-9fe4-09c205cf3491 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.089743 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4e90-c575-4728-9fe4-09c205cf3491 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.094430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35690a3-1c88-4583-962d-354503a45b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.095077 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35690a3-1c88-4583-962d-354503a45b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.095418 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35690a3-1c88-4583-962d-354503a45b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.095699 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35690a3-1c88-4583-962d-354503a45b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.096382 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35690a3-1c88-4583-962d-354503a45b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.098578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35690a3-1c88-4583-962d-354503a45b3e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.123199 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1441/2862] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:50:37 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:37.127906 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.137730 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779589c-d0d6-423f-bbc4-e020dcc34866 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.163266 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:37.194569 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd002860-f32e-4dad-9df9-7d78f6871a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.195393 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd002860-f32e-4dad-9df9-7d78f6871a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.195514 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd002860-f32e-4dad-9df9-7d78f6871a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.195764 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd002860-f32e-4dad-9df9-7d78f6871a43 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.196445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd002860-f32e-4dad-9df9-7d78f6871a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.198380 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd002860-f32e-4dad-9df9-7d78f6871a43 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.218888 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1422/2863] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:50:37 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:37.223349 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35690a3-1c88-4583-962d-354503a45b3e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.233994 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35690a3-1c88-4583-962d-354503a45b3e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.238654 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a42bf-d952-4785-be21-8f8ecd163b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.239311 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a42bf-d952-4785-be21-8f8ecd163b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.239594 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a42bf-d952-4785-be21-8f8ecd163b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.239870 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a42bf-d952-4785-be21-8f8ecd163b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.240592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a42bf-d952-4785-be21-8f8ecd163b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.242231 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a42bf-d952-4785-be21-8f8ecd163b72 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.252971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1442/2864] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:37.256638 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd002860-f32e-4dad-9df9-7d78f6871a43 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.266396 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd002860-f32e-4dad-9df9-7d78f6871a43 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.271535 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6806527-d3a9-4b2f-b08c-ab53d3abcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.272184 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806527-d3a9-4b2f-b08c-ab53d3abcc7a admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.272468 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806527-d3a9-4b2f-b08c-ab53d3abcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.272748 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806527-d3a9-4b2f-b08c-ab53d3abcc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.273504 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6806527-d3a9-4b2f-b08c-ab53d3abcc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.275080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6806527-d3a9-4b2f-b08c-ab53d3abcc7a admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.284783 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1423/2865] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:50:37.288698 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a42bf-d952-4785-be21-8f8ecd163b72 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.298701 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a42bf-d952-4785-be21-8f8ecd163b72 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.303433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc3d86-98e0-43f4-aa11-5d2bfba25670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.304378 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc3d86-98e0-43f4-aa11-5d2bfba25670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.304655 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc3d86-98e0-43f4-aa11-5d2bfba25670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.304977 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc3d86-98e0-43f4-aa11-5d2bfba25670 admin admin] PATH_INFO: `/v3/projects/e5f28cdce42b4708b25bcf9908479977/users/06748ef10d6d4010a76e9385145adb94/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.319918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc3d86-98e0-43f4-aa11-5d2bfba25670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f28cdce42b4708b25bcf9908479977, user_id=06748ef10d6d4010a76e9385145adb94, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.322636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc3d86-98e0-43f4-aa11-5d2bfba25670 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.336070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1443/2866] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:37 2022] PUT /identity/v3/projects/e5f28cdce42b4708b25bcf9908479977/users/06748ef10d6d4010a76e9385145adb94/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:37.394388 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed52e9-f130-40db-9c8d-2d7c0b5d76a9 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.394704 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed52e9-f130-40db-9c8d-2d7c0b5d76a9 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.394985 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed52e9-f130-40db-9c8d-2d7c0b5d76a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.421053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c8ed52e9-f130-40db-9c8d-2d7c0b5d76a9 None None] MFA Rules not processed for user `06748ef10d6d4010a76e9385145adb94`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:37.422189 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c8ed52e9-f130-40db-9c8d-2d7c0b5d76a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:37.484670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1424/2867] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:37.489867 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc3d86-98e0-43f4-aa11-5d2bfba25670 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.550334 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc3d86-98e0-43f4-aa11-5d2bfba25670 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.554987 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b945e-5e0d-4ed1-8818-6ba1091dfa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.555636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b945e-5e0d-4ed1-8818-6ba1091dfa9a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.555922 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b945e-5e0d-4ed1-8818-6ba1091dfa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.556201 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b945e-5e0d-4ed1-8818-6ba1091dfa9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.556904 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b945e-5e0d-4ed1-8818-6ba1091dfa9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.558807 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b945e-5e0d-4ed1-8818-6ba1091dfa9a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.583376 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1444/2868] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:50:37 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:50:37.587375 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed52e9-f130-40db-9c8d-2d7c0b5d76a9 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.598161 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed52e9-f130-40db-9c8d-2d7c0b5d76a9 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.653287 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1f9f-40c2-4e7d-98a3-3f561178f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.653954 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1f9f-40c2-4e7d-98a3-3f561178f487 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.654244 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1f9f-40c2-4e7d-98a3-3f561178f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.654526 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1f9f-40c2-4e7d-98a3-3f561178f487 admin admin] PATH_INFO: `/v3/users` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.655211 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc1f9f-40c2-4e7d-98a3-3f561178f487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.657188 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc1f9f-40c2-4e7d-98a3-3f561178f487 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.676993 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1425/2869] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:50:37 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:37.680869 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b945e-5e0d-4ed1-8818-6ba1091dfa9a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.691570 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b945e-5e0d-4ed1-8818-6ba1091dfa9a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.696445 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88616547-db70-4426-842a-a1baa0f8df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.697142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616547-db70-4426-842a-a1baa0f8df56 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.697433 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616547-db70-4426-842a-a1baa0f8df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.697716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616547-db70-4426-842a-a1baa0f8df56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.698472 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88616547-db70-4426-842a-a1baa0f8df56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.700074 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88616547-db70-4426-842a-a1baa0f8df56 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.710553 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1445/2870] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:37.714423 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1f9f-40c2-4e7d-98a3-3f561178f487 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.724995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1f9f-40c2-4e7d-98a3-3f561178f487 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.729543 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe80661-1728-4658-a8e4-61301eec187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.730414 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80661-1728-4658-a8e4-61301eec187c admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.730695 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80661-1728-4658-a8e4-61301eec187c admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.730963 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80661-1728-4658-a8e4-61301eec187c admin admin] PATH_INFO: `/v3/projects/e86e5f08175c40e18e1e1c1a0b972a56/users/245791e22720409f94f99a712af12f77/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.745841 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe80661-1728-4658-a8e4-61301eec187c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86e5f08175c40e18e1e1c1a0b972a56, user_id=245791e22720409f94f99a712af12f77, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.748475 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe80661-1728-4658-a8e4-61301eec187c admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.760714 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1426/2871] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:37 2022] PUT /identity/v3/projects/e86e5f08175c40e18e1e1c1a0b972a56/users/245791e22720409f94f99a712af12f77/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:50:37.764706 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88616547-db70-4426-842a-a1baa0f8df56 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.774698 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88616547-db70-4426-842a-a1baa0f8df56 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.794400 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:37.830886 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b607c-2fdb-48e1-8873-48160e863563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.831552 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b607c-2fdb-48e1-8873-48160e863563 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.831838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b607c-2fdb-48e1-8873-48160e863563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.832117 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b607c-2fdb-48e1-8873-48160e863563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.832859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b607c-2fdb-48e1-8873-48160e863563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.834452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b607c-2fdb-48e1-8873-48160e863563 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.843938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1446/2872] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:37.848967 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe80661-1728-4658-a8e4-61301eec187c admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:37.854433 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:37.861525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe80661-1728-4658-a8e4-61301eec187c admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:37.866363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:37.867245 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.867528 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.867805 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] PATH_INFO: `/v3/projects/e86e5f08175c40e18e1e1c1a0b972a56/users/245791e22720409f94f99a712af12f77/roles/fc9319be35744f288d5ef1dbfc8b5961` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.869982 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86e5f08175c40e18e1e1c1a0b972a56, user_id=245791e22720409f94f99a712af12f77, role_id=fc9319be35744f288d5ef1dbfc8b5961)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:37.872616 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:37.882896 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1427/2873] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:37 2022] PUT /identity/v3/projects/e86e5f08175c40e18e1e1c1a0b972a56/users/245791e22720409f94f99a712af12f77/roles/fc9319be35744f288d5ef1dbfc8b5961 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:37.892883 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935d9c-4a4b-4934-b018-74ec4a4fb582 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:37.893206 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935d9c-4a4b-4934-b018-74ec4a4fb582 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:37.893490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935d9c-4a4b-4934-b018-74ec4a4fb582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:37.919838 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fe935d9c-4a4b-4934-b018-74ec4a4fb582 None None] MFA Rules not processed for user `245791e22720409f94f99a712af12f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:37.921081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fe935d9c-4a4b-4934-b018-74ec4a4fb582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:37.988786 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1447/2874] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:50:37.999220 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:38.000939 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:38.057666 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d44bc3-0539-4d56-a7af-507cc3fcca22 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:38.061321 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:38.061961 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:38.062249 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:38.062534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:38.117264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:38.118687 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:38.127413 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1428/2875] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:40.666681 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935d9c-4a4b-4934-b018-74ec4a4fb582 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:40.676816 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935d9c-4a4b-4934-b018-74ec4a4fb582 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:40.680405 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841031a-6ae1-4008-bcd8-3aa2d918d548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6a8bf853cd4b60916375d9ebbd468f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:40.681083 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841031a-6ae1-4008-bcd8-3aa2d918d548 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:40.681373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841031a-6ae1-4008-bcd8-3aa2d918d548 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:40.681656 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841031a-6ae1-4008-bcd8-3aa2d918d548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:40.691099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841031a-6ae1-4008-bcd8-3aa2d918d548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:40.692528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841031a-6ae1-4008-bcd8-3aa2d918d548 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:40.701888 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1448/2876] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:48.123363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:50.354403 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:50.355854 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:50.446450 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2f089-4eac-4da7-9e60-ceeee4862907 service cinder] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:50.451470 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1f86e-a3d6-4e46-a0b7-36b880c621d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:50.452148 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1f86e-a3d6-4e46-a0b7-36b880c621d5 service placement] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:50.452438 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1f86e-a3d6-4e46-a0b7-36b880c621d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:50.452721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1f86e-a3d6-4e46-a0b7-36b880c621d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:50.455084 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-4ef1f86e-a3d6-4e46-a0b7-36b880c621d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:50.466589 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1f86e-a3d6-4e46-a0b7-36b880c621d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:50.468435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1f86e-a3d6-4e46-a0b7-36b880c621d5 service placement] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:50.479191 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1429/2877] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:50.697679 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=58 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:53.075884 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841031a-6ae1-4008-bcd8-3aa2d918d548 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:53.137360 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841031a-6ae1-4008-bcd8-3aa2d918d548 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:53.141818 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:53.142676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:53.142964 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:53.143244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] PATH_INFO: `/v3/users/06748ef10d6d4010a76e9385145adb94` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:53.144454 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06748ef10d6d4010a76e9385145adb94)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:53.146402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:53.194191 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06748ef10d6d4010a76e9385145adb94'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.206249 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06748ef10d6d4010a76e9385145adb94'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.213578 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06748ef10d6d4010a76e9385145adb94'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.214254 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06748ef10d6d4010a76e9385145adb94'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.214923 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06748ef10d6d4010a76e9385145adb94'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.227474 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1449/2878] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:50:53 2022] DELETE /identity/v3/users/06748ef10d6d4010a76e9385145adb94 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:53.232226 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8152-5c9f-4bd7-b2bf-dddc8b8e6b27 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:53.233209 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8152-5c9f-4bd7-b2bf-dddc8b8e6b27 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:53.233713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8152-5c9f-4bd7-b2bf-dddc8b8e6b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:53.251986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-9c1a8152-5c9f-4bd7-b2bf-dddc8b8e6b27 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:53.253222 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9c1a8152-5c9f-4bd7-b2bf-dddc8b8e6b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:53.311061 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1430/2879] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:53.321085 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:53.322482 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:53.379434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d7f62-cf53-4eed-8e2e-89d3f824c974 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:53.383142 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f38b4a-3331-4272-9a42-d63351da71ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:53.383785 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38b4a-3331-4272-9a42-d63351da71ae service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:53.384072 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38b4a-3331-4272-9a42-d63351da71ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:53.384352 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38b4a-3331-4272-9a42-d63351da71ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:53.393479 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f38b4a-3331-4272-9a42-d63351da71ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:53.394861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f38b4a-3331-4272-9a42-d63351da71ae service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:53.404190 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1450/2880] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:53.662105 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8152-5c9f-4bd7-b2bf-dddc8b8e6b27 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:53.663630 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-9c1a8152-5c9f-4bd7-b2bf-dddc8b8e6b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:53.676025 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8152-5c9f-4bd7-b2bf-dddc8b8e6b27 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:53.680839 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:53.681721 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:53.682033 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:53.682286 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] PATH_INFO: `/v3/projects/e5f28cdce42b4708b25bcf9908479977` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:53.683574 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f28cdce42b4708b25bcf9908479977)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:53.685540 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:53.733279 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f28cdce42b4708b25bcf9908479977', 'request_id': 'req-390fd169-98e9-4f81-acee-df85a9a5d41b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.739858 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f28cdce42b4708b25bcf9908479977', 'request_id': 'req-390fd169-98e9-4f81-acee-df85a9a5d41b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.745482 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f28cdce42b4708b25bcf9908479977', 'request_id': 'req-390fd169-98e9-4f81-acee-df85a9a5d41b'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.747880 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:53.758415 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] The token cache is being invalidate because project e5f28cdce42b4708b25bcf9908479977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:53.758705 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.759324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.760910 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1431/2881] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:50:53 2022] DELETE /identity/v3/projects/e5f28cdce42b4708b25bcf9908479977 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:53.764900 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f38b4a-3331-4272-9a42-d63351da71ae service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:53.774588 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f38b4a-3331-4272-9a42-d63351da71ae service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:53.792490 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:53.832897 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:53.833765 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:53.834048 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:53.834325 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] PATH_INFO: `/v3/users/245791e22720409f94f99a712af12f77` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:53.835516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245791e22720409f94f99a712af12f77)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:53.837498 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:53.884379 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245791e22720409f94f99a712af12f77'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.896503 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245791e22720409f94f99a712af12f77'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.903720 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245791e22720409f94f99a712af12f77'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.904393 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245791e22720409f94f99a712af12f77'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.905033 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6d66c63b-5ed6-4b41-af22-b81185ebe313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245791e22720409f94f99a712af12f77'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:53.917685 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1451/2882] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:50:53 2022] DELETE /identity/v3/users/245791e22720409f94f99a712af12f77 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:54.182830 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.184309 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:54.198789 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fd169-98e9-4f81-acee-df85a9a5d41b admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.257584 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.258436 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.258713 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.258986 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] PATH_INFO: `/v3/projects/e86e5f08175c40e18e1e1c1a0b972a56` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.260176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86e5f08175c40e18e1e1c1a0b972a56)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.262181 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.310569 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86e5f08175c40e18e1e1c1a0b972a56', 'request_id': 'req-f162a45d-4149-45a1-9172-a38116fdbf66'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:54.317155 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86e5f08175c40e18e1e1c1a0b972a56', 'request_id': 'req-f162a45d-4149-45a1-9172-a38116fdbf66'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:54.322552 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86e5f08175c40e18e1e1c1a0b972a56', 'request_id': 'req-f162a45d-4149-45a1-9172-a38116fdbf66'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:54.335670 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] The token cache is being invalidate because project e86e5f08175c40e18e1e1c1a0b972a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:54.335953 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:54.336599 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f162a45d-4149-45a1-9172-a38116fdbf66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:54.338157 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1432/2883] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:50:54 2022] DELETE /identity/v3/projects/e86e5f08175c40e18e1e1c1a0b972a56 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:54.343260 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52533d-82ed-4e43-b267-950016da0745 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.343774 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52533d-82ed-4e43-b267-950016da0745 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.343887 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52533d-82ed-4e43-b267-950016da0745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.362042 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-da52533d-82ed-4e43-b267-950016da0745 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:54.363270 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-da52533d-82ed-4e43-b267-950016da0745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:54.421895 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1452/2884] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:54.430712 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4ad29-6a31-4e7d-a28c-730c878b5d37 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.430948 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4ad29-6a31-4e7d-a28c-730c878b5d37 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.431230 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4ad29-6a31-4e7d-a28c-730c878b5d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.451223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-72a4ad29-6a31-4e7d-a28c-730c878b5d37 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:54.452441 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-72a4ad29-6a31-4e7d-a28c-730c878b5d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:54.461792 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1433/2885] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:54.465861 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52533d-82ed-4e43-b267-950016da0745 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.476069 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52533d-82ed-4e43-b267-950016da0745 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.480716 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.481402 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.481686 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.481962 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.482684 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:50:54.482992 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.484587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.495915 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1453/2886] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:50:54.500053 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4ad29-6a31-4e7d-a28c-730c878b5d37 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.509644 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4ad29-6a31-4e7d-a28c-730c878b5d37 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.514251 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f91-89c3-4a10-9d7f-aee80f5d35d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.514893 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f91-89c3-4a10-9d7f-aee80f5d35d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.515172 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f91-89c3-4a10-9d7f-aee80f5d35d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.515445 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f91-89c3-4a10-9d7f-aee80f5d35d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.516130 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b3f91-89c3-4a10-9d7f-aee80f5d35d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.518118 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b3f91-89c3-4a10-9d7f-aee80f5d35d9 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.543513 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1434/2887] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:50:54 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:50:54.547587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.557516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d266c6f-d5a0-4e9a-b8bc-f733109b3ac8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.583773 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:54.615893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce67d1-22e7-4731-b5dd-b69dc19f7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.616558 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce67d1-22e7-4731-b5dd-b69dc19f7ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.616866 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce67d1-22e7-4731-b5dd-b69dc19f7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.617151 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce67d1-22e7-4731-b5dd-b69dc19f7ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.617849 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce67d1-22e7-4731-b5dd-b69dc19f7ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.619769 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce67d1-22e7-4731-b5dd-b69dc19f7ac7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.638919 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1454/2888] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:50:54 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:54.643708 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f91-89c3-4a10-9d7f-aee80f5d35d9 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.653785 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f91-89c3-4a10-9d7f-aee80f5d35d9 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.658909 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fad56-78c8-4532-9ea2-8d6293ebae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.659566 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fad56-78c8-4532-9ea2-8d6293ebae90 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.659853 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fad56-78c8-4532-9ea2-8d6293ebae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.660134 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fad56-78c8-4532-9ea2-8d6293ebae90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.660876 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fad56-78c8-4532-9ea2-8d6293ebae90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.662479 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fad56-78c8-4532-9ea2-8d6293ebae90 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.672688 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1435/2889] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:50:54.676791 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce67d1-22e7-4731-b5dd-b69dc19f7ac7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.689337 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce67d1-22e7-4731-b5dd-b69dc19f7ac7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.694169 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f39d29-c2d6-4d7a-ab75-5ea2f57a149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.694844 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f39d29-c2d6-4d7a-ab75-5ea2f57a149a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.695140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f39d29-c2d6-4d7a-ab75-5ea2f57a149a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.695394 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f39d29-c2d6-4d7a-ab75-5ea2f57a149a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.696108 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f39d29-c2d6-4d7a-ab75-5ea2f57a149a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.697761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f39d29-c2d6-4d7a-ab75-5ea2f57a149a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.708912 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1455/2890] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:54.713293 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fad56-78c8-4532-9ea2-8d6293ebae90 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.724363 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fad56-78c8-4532-9ea2-8d6293ebae90 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.728923 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.729787 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.730064 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.730336 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] PATH_INFO: `/v3/projects/4e4a623720d04d9180740dc1c6c7e058/users/0bbc81ff8bb948cc9ffe3ced55231047/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.744435 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4a623720d04d9180740dc1c6c7e058, user_id=0bbc81ff8bb948cc9ffe3ced55231047, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.747264 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.760072 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1436/2891] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:50:54 2022] PUT /identity/v3/projects/4e4a623720d04d9180740dc1c6c7e058/users/0bbc81ff8bb948cc9ffe3ced55231047/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:50:54.770680 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ada0-16af-4247-81bf-a664190faacc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.770975 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ada0-16af-4247-81bf-a664190faacc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.771284 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ada0-16af-4247-81bf-a664190faacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.797761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6650ada0-16af-4247-81bf-a664190faacc None None] MFA Rules not processed for user `0bbc81ff8bb948cc9ffe3ced55231047`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:54.798971 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6650ada0-16af-4247-81bf-a664190faacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:54.861434 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1456/2892] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:50:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:54.872477 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.874162 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:54.896034 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:54.931402 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2f5d-f341-4df8-93a6-c438856e2773 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.935154 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c479ba-eadd-4abd-ae9c-08e74922abc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.935796 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c479ba-eadd-4abd-ae9c-08e74922abc6 service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.936080 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c479ba-eadd-4abd-ae9c-08e74922abc6 service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.936357 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c479ba-eadd-4abd-ae9c-08e74922abc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.944480 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c479ba-eadd-4abd-ae9c-08e74922abc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.945881 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c479ba-eadd-4abd-ae9c-08e74922abc6 service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.954995 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1437/2893] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:50:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:51:04.858457 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:04.950585 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=17 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:09.316852 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ada0-16af-4247-81bf-a664190faacc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:09.377506 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ada0-16af-4247-81bf-a664190faacc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:09.381958 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:09.382814 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:09.383099 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:09.383373 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] PATH_INFO: `/v3/users/0bbc81ff8bb948cc9ffe3ced55231047` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:09.384537 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbc81ff8bb948cc9ffe3ced55231047)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:09.386481 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:09.430999 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbc81ff8bb948cc9ffe3ced55231047'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:09.443344 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbc81ff8bb948cc9ffe3ced55231047'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:09.456452 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbc81ff8bb948cc9ffe3ced55231047'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:09.457383 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbc81ff8bb948cc9ffe3ced55231047'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:09.458006 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbc81ff8bb948cc9ffe3ced55231047'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:09.470090 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1457/2894] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:51:09 2022] DELETE /identity/v3/users/0bbc81ff8bb948cc9ffe3ced55231047 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:09.474892 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407138-67e0-412e-9fc2-246524f3fe86 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:09.475356 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407138-67e0-412e-9fc2-246524f3fe86 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:09.475495 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407138-67e0-412e-9fc2-246524f3fe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:09.492012 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-46407138-67e0-412e-9fc2-246524f3fe86 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:09.493257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-46407138-67e0-412e-9fc2-246524f3fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:09.551002 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1438/2895] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:09.560513 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:09.562093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:09.619318 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c557-298d-4794-8929-c8bc7be34f27 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:09.623011 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5cbb-681c-49c2-8d87-49e99c0d2ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:09.623650 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5cbb-681c-49c2-8d87-49e99c0d2ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:09.623938 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5cbb-681c-49c2-8d87-49e99c0d2ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:09.624218 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5cbb-681c-49c2-8d87-49e99c0d2ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:09.633338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d5cbb-681c-49c2-8d87-49e99c0d2ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:09.634779 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d5cbb-681c-49c2-8d87-49e99c0d2ba2 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:09.644747 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1458/2896] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:09.903784 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46407138-67e0-412e-9fc2-246524f3fe86 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:09.905265 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-46407138-67e0-412e-9fc2-246524f3fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:09.917676 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46407138-67e0-412e-9fc2-246524f3fe86 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:09.924176 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:09.925534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:09.925534 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:09.925826 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] PATH_INFO: `/v3/projects/4e4a623720d04d9180740dc1c6c7e058` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:09.928208 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4a623720d04d9180740dc1c6c7e058)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:09.930223 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:09.978621 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4a623720d04d9180740dc1c6c7e058', 'request_id': 'req-03d04401-41e3-46ab-b108-917660761e29'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:09.984657 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4a623720d04d9180740dc1c6c7e058', 'request_id': 'req-03d04401-41e3-46ab-b108-917660761e29'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:09.990088 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4a623720d04d9180740dc1c6c7e058', 'request_id': 'req-03d04401-41e3-46ab-b108-917660761e29'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:10.002707 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] The token cache is being invalidate because project 4e4a623720d04d9180740dc1c6c7e058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:10.003019 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:10.003637 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-03d04401-41e3-46ab-b108-917660761e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:10.005205 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1439/2897] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:51:09 2022] DELETE /identity/v3/projects/4e4a623720d04d9180740dc1c6c7e058 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:51:10.010138 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1205f5-f993-48db-971c-d0695a5fc9f2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.010430 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1205f5-f993-48db-971c-d0695a5fc9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.010737 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1205f5-f993-48db-971c-d0695a5fc9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.029140 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9a1205f5-f993-48db-971c-d0695a5fc9f2 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:10.030338 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9a1205f5-f993-48db-971c-d0695a5fc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:10.046719 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:10.090412 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1459/2898] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:10.099443 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d96c0-be33-45e2-a47b-3e8ecd13a7e3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.099735 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d96c0-be33-45e2-a47b-3e8ecd13a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.100020 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d96c0-be33-45e2-a47b-3e8ecd13a7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.117882 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-c30d96c0-be33-45e2-a47b-3e8ecd13a7e3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:10.119075 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-c30d96c0-be33-45e2-a47b-3e8ecd13a7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:10.127344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1440/2899] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:10.131397 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1205f5-f993-48db-971c-d0695a5fc9f2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:10.141093 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1205f5-f993-48db-971c-d0695a5fc9f2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:10.146244 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:10.146893 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.147179 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.147459 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.148175 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:10.148483 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:10.150194 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:10.161528 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1460/2900] 10.222.0.79 () {58 vars in 1152 bytes} [Fri May 27 09:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:51:10.165597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d96c0-be33-45e2-a47b-3e8ecd13a7e3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:10.174605 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d96c0-be33-45e2-a47b-3e8ecd13a7e3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:10.179253 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2071f-772b-4713-b76a-4bfbf10ec782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:10.179895 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2071f-772b-4713-b76a-4bfbf10ec782 admin admin] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.180178 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2071f-772b-4713-b76a-4bfbf10ec782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.180456 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2071f-772b-4713-b76a-4bfbf10ec782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.181206 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2071f-772b-4713-b76a-4bfbf10ec782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:10.183127 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2071f-772b-4713-b76a-4bfbf10ec782 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:10.208747 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1441/2901] 10.222.0.79 () {60 vars in 1152 bytes} [Fri May 27 09:51:10 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:10.212910 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:10.223005 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f73a5-e028-4a40-825f-e3c9d94f188f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:10.279153 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1e40e-1dd3-4241-937b-1724c56ba51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:10.279817 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e40e-1dd3-4241-937b-1724c56ba51a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.280097 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e40e-1dd3-4241-937b-1724c56ba51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.280372 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e40e-1dd3-4241-937b-1724c56ba51a admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.281081 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1e40e-1dd3-4241-937b-1724c56ba51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:10.283028 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1e40e-1dd3-4241-937b-1724c56ba51a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:10.303689 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1461/2902] 10.222.0.79 () {60 vars in 1143 bytes} [Fri May 27 09:51:10 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:10.307733 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2071f-772b-4713-b76a-4bfbf10ec782 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:10.318422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2071f-772b-4713-b76a-4bfbf10ec782 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:10.323031 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f144fac-4177-4d56-966a-3fa01e451758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:10.323683 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f144fac-4177-4d56-966a-3fa01e451758 admin admin] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.323971 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f144fac-4177-4d56-966a-3fa01e451758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.324246 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f144fac-4177-4d56-966a-3fa01e451758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.325006 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f144fac-4177-4d56-966a-3fa01e451758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:10.326597 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f144fac-4177-4d56-966a-3fa01e451758 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:10.337274 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1442/2903] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:10.341002 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1e40e-1dd3-4241-937b-1724c56ba51a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:10.350927 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1e40e-1dd3-4241-937b-1724c56ba51a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:10.355564 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c1634-ee12-49ae-ac3d-cb5cdca560fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:10.356209 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c1634-ee12-49ae-ac3d-cb5cdca560fa admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.356488 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c1634-ee12-49ae-ac3d-cb5cdca560fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.356980 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c1634-ee12-49ae-ac3d-cb5cdca560fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.357516 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c1634-ee12-49ae-ac3d-cb5cdca560fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:10.359105 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c1634-ee12-49ae-ac3d-cb5cdca560fa admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:10.369328 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1462/2904] 10.222.0.79 () {58 vars in 1121 bytes} [Fri May 27 09:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:10.373335 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f144fac-4177-4d56-966a-3fa01e451758 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:10.383973 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f144fac-4177-4d56-966a-3fa01e451758 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:10.388588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:10.389527 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.389807 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.390085 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] PATH_INFO: `/v3/projects/5b5959da7e754252b703062b372518b7/users/67c59089da394da7bdb2946467880c53/roles/eb3e1f4520ed4e8f873819a4830e3399` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.405846 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5959da7e754252b703062b372518b7, user_id=67c59089da394da7bdb2946467880c53, role_id=eb3e1f4520ed4e8f873819a4830e3399)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:10.408673 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:10.421457 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1443/2905] 10.222.0.79 () {60 vars in 1482 bytes} [Fri May 27 09:51:10 2022] PUT /identity/v3/projects/5b5959da7e754252b703062b372518b7/users/67c59089da394da7bdb2946467880c53/roles/eb3e1f4520ed4e8f873819a4830e3399 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:10.432032 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc0ca-ab48-4ee7-9ae7-2b964ab8178c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.432322 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc0ca-ab48-4ee7-9ae7-2b964ab8178c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.432600 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc0ca-ab48-4ee7-9ae7-2b964ab8178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.459385 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3b1dc0ca-ab48-4ee7-9ae7-2b964ab8178c None None] MFA Rules not processed for user `67c59089da394da7bdb2946467880c53`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:10.460705 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3b1dc0ca-ab48-4ee7-9ae7-2b964ab8178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:10.523647 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1463/2906] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:51:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:10.535324 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:10.537086 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:10.559142 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:10.597567 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086782b-d46e-4a83-98b5-b5b3259892c2 admin admin] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:10.601319 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403369d-751b-4683-8f3f-bc58f21d3e54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b11f7990b364f5281def98b941e1e00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:10.601970 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403369d-751b-4683-8f3f-bc58f21d3e54 service glance] REQUEST_METHOD: `GET` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:10.602257 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403369d-751b-4683-8f3f-bc58f21d3e54 service glance] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:10.602539 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403369d-751b-4683-8f3f-bc58f21d3e54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:10.611347 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403369d-751b-4683-8f3f-bc58f21d3e54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:10.612779 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403369d-751b-4683-8f3f-bc58f21d3e54 service glance] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:10.621588 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1444/2907] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:51:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:20.520610 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:20.617548 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=17 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:32.223135 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dc0ca-ab48-4ee7-9ae7-2b964ab8178c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:32.286587 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dc0ca-ab48-4ee7-9ae7-2b964ab8178c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:32.291136 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:32.292007 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:32.292295 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:32.292572 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] PATH_INFO: `/v3/users/67c59089da394da7bdb2946467880c53` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:32.293809 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c59089da394da7bdb2946467880c53)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:32.295734 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:32.343122 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c59089da394da7bdb2946467880c53'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.356665 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c59089da394da7bdb2946467880c53'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.364411 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c59089da394da7bdb2946467880c53'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.365070 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c59089da394da7bdb2946467880c53'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.365676 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c59089da394da7bdb2946467880c53'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.378520 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1464/2908] 10.222.0.79 () {58 vars in 1223 bytes} [Fri May 27 09:51:32 2022] DELETE /identity/v3/users/67c59089da394da7bdb2946467880c53 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:32.383112 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8f1c0-5cc6-49b7-a09d-7935001fccd3 None None] REQUEST_METHOD: `POST` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:32.383618 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8f1c0-5cc6-49b7-a09d-7935001fccd3 None None] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:32.383731 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8f1c0-5cc6-49b7-a09d-7935001fccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:32.400278 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.auth.core [None req-d3c8f1c0-5cc6-49b7-a09d-7935001fccd3 None None] MFA Rules not processed for user `35a1bb04fdb644fe910032efa086d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:32.401489 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d3c8f1c0-5cc6-49b7-a09d-7935001fccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:32.458217 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1445/2909] 10.222.0.79 () {58 vars in 957 bytes} [Fri May 27 09:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:51:32.467918 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:32.469960 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:32.526257 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f97583-5d5b-40b2-b743-cae5b312a44d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:32.529859 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebee38389afb4270b18c6a14c7a4e302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:32.530493 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:32.530780 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:32.531053 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:32.540387 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:32.541853 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:32.551592 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1465/2910] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:32.813107 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8f1c0-5cc6-49b7-a09d-7935001fccd3 None None] Authenticating user token {{(pid=80148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:32.814546 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.fernet_utils [None req-d3c8f1c0-5cc6-49b7-a09d-7935001fccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:32.827454 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8f1c0-5cc6-49b7-a09d-7935001fccd3 None None] Validating token access rules against request {{(pid=80148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:32.832216 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35a1bb04fdb644fe910032efa086d057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1d06ca36e140b391bdeae31455b36e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:32.833212 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:32.833525 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:32.833801 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] PATH_INFO: `/v3/projects/5b5959da7e754252b703062b372518b7` {{(pid=80148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:32.835092 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5959da7e754252b703062b372518b7)` {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:32.837003 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] RBAC: Authorization granted {{(pid=80148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:32.883344 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5959da7e754252b703062b372518b7', 'request_id': 'req-f02593b7-29d5-435c-ad25-f279dbd733c4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.889422 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5959da7e754252b703062b372518b7', 'request_id': 'req-f02593b7-29d5-435c-ad25-f279dbd733c4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.895354 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5959da7e754252b703062b372518b7', 'request_id': 'req-f02593b7-29d5-435c-ad25-f279dbd733c4'} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.908492 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] The token cache is being invalidate because project 5b5959da7e754252b703062b372518b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:32.908788 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.909449 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG keystone.notifications [None req-f02593b7-29d5-435c-ad25-f279dbd733c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:32.911008 dv-cinder-797608-21-smb devstack@keystone.service[80148]: [pid: 80148|app: 0|req: 1446/2911] 10.222.0.79 () {58 vars in 1232 bytes} [Fri May 27 09:51:32 2022] DELETE /identity/v3/projects/5b5959da7e754252b703062b372518b7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:42.547475 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:42.904601 dv-cinder-797608-21-smb devstack@keystone.service[80148]: DEBUG dbcounter [-] [80148] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:55:58.294219 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:55:58.295761 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:55:58.361636 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbdaaa-dd47-4d3f-a4f1-db41e6475eb3 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:55:58.417499 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711db7c-755f-444d-8d48-f52d10438cff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e79a5d5bbecb4835b3e8f4128b347aeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28d7e08d08ce4e51a0b752b6a286df86', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:55:58.418143 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711db7c-755f-444d-8d48-f52d10438cff service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:55:58.418423 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711db7c-755f-444d-8d48-f52d10438cff service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:55:58.418703 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711db7c-755f-444d-8d48-f52d10438cff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:55:58.420439 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8711db7c-755f-444d-8d48-f52d10438cff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:55:58.431308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711db7c-755f-444d-8d48-f52d10438cff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:55:58.432891 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711db7c-755f-444d-8d48-f52d10438cff service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:55:58.442484 dv-cinder-797608-21-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1466/2912] 10.222.0.79 () {60 vars in 1365 bytes} [Fri May 27 09:55:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:08.438308 dv-cinder-797608-21-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=58 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}